AreWeCompressedYet - Revision history

Tdaede at 22:48, 29 August 2017

2017-08-29T22:48:47Z

← Older revision		Revision as of 22:48, 29 August 2017
Line 109:		Line 109:
	UserKnownHostsFile=/dev/null		UserKnownHostsFile=/dev/null
	LogLevel ERROR		LogLevel ERROR
			</pre>

			== Common issues ==

			=== Runs don't display ===
			<pre>
			sudo su awcy
			cd ~/awcy
			node generate_list.js
	</pre>		</pre>

	[[Category:Daala]]		[[Category:Daala]]

MrZeus: /* Usage */ make images float to left, pad field descriptions out a bit.

2017-01-18T16:53:36Z

Usage: make images float to left, pad field descriptions out a bit.

← Older revision		Revision as of 16:53, 18 January 2017
Line 9:		Line 9:
	===Submitting a Run===		===Submitting a Run===

	~~Choose the Active Runs tab, then the green "Submit New Job" button~~.		[[File:Awcy submit new job.png\|right\|frameless\|450px]]

	~~[[File:Awcy submit new job~~.~~png\|409px]]~~		Choose the '''Active Runs''' tab, then the green '''Submit New Job''' button.

	[[File:Awcy options.png\|~~432px~~]]		[[File:Awcy options.png\|right\|frameless\|450px]]

	* '''Run ID''' - A unique name for ~~the~~ run~~, prefilled~~ with date.		* '''Run ID''' - A unique name for your run (this is filled with the current date and time as a default)
	* '''Git Commit Hash''' - The hash of the commit to be tested. This must be visible either on Gerrit or a specially installed personal repo. This is the "Commit" on Gerrit and not the Change-Id or tree hash.		* '''Git Commit Hash''' - The hash of the commit to be tested. This must be visible either on Gerrit or a specially installed personal repo. This is the "Commit" on Gerrit and not the Change-Id or tree hash.
	* '''Codec''' - ~~Selects both Codec~~ and default options.		* '''Codec''' - The codec you want to test and certain default options.
	* '''Set''' - videos to ~~run~~.		* '''Set''' - The set of videos or images you want to test the codec with.
	* '''Extra CLI options''' - ~~Passed~~ to encoder ~~binary~~ along with the defaults. Usually not needed.		* '''Extra CLI options''' - Optional parameters, which are passed to the encoder along with the defaults. Usually not needed.
	* '''Extra build options''' - ~~Passed~~ to configure script. For AV1, pass flags to enable experiments here. (for example, --enable-experimental --enable-feature)		* '''Extra build options''' - Optional parameters, which are passed to the configure script. For AV1, pass flags to enable experiments here. (for example, --enable-experimental --enable-feature)
	* '''IRC nick''' - Name to notify on #daala, also ~~for sorting~~ runs.		* '''IRC nick''' - Name to notify on #daala. This can also be used to sort your runs.
	* '''Custom qualities''' - ~~optional, specifies~~ quantizers to use ~~instead~~ of ~~the defaults~~.		* '''Custom qualities''' - Optional list of quantizers to use (these override the default list of quantisers).

	==Repos==		==Repos==

Tdaede: /* Submitting a Run */

2017-01-17T23:35:55Z

Submitting a Run

← Older revision		Revision as of 23:35, 17 January 2017
Line 11:		Line 11:
	Choose the Active Runs tab, then the green "Submit New Job" button.		Choose the Active Runs tab, then the green "Submit New Job" button.

	[[File:Awcy submit new job.png\|~~414px~~]]		[[File:Awcy submit new job.png\|409px]]

	[[File:Awcy options.png\|432px]]		[[File:Awcy options.png\|432px]]

Tdaede at 23:35, 17 January 2017

2017-01-17T23:35:04Z

← Older revision		Revision as of 23:35, 17 January 2017
Line 4:		Line 4:

	For bugs and enhancements, see its [https://github.com/tdaede/awcy/issues GitHub Issues] page.		For bugs and enhancements, see its [https://github.com/tdaede/awcy/issues GitHub Issues] page.

			==Usage==

			===Submitting a Run===

			Choose the Active Runs tab, then the green "Submit New Job" button.

			[[File:Awcy submit new job.png\|414px]]

			[[File:Awcy options.png\|432px]]

			* '''Run ID''' - A unique name for the run, prefilled with date.
			* '''Git Commit Hash''' - The hash of the commit to be tested. This must be visible either on Gerrit or a specially installed personal repo. This is the "Commit" on Gerrit and not the Change-Id or tree hash.
			* '''Codec''' - Selects both Codec and default options.
			* '''Set''' - videos to run.
			* '''Extra CLI options''' - Passed to encoder binary along with the defaults. Usually not needed.
			* '''Extra build options''' - Passed to configure script. For AV1, pass flags to enable experiments here. (for example, --enable-experimental --enable-feature)
			* '''IRC nick''' - Name to notify on #daala, also for sorting runs.
			* '''Custom qualities''' - optional, specifies quantizers to use instead of the defaults.

	==Repos==		==Repos==

MrZeus: /* nginx */ boldify, linkify.

2016-12-07T16:59:20Z

nginx: boldify, linkify.

← Older revision		Revision as of 16:59, 7 December 2016
Line 41:		Line 41:

	====nginx====		====nginx====
	NGINX is configured to be a TLS endpoint and proxy_pass to localhost:3000. Certificates are managed by certbot and issued by Let's Encrypt.		NGINX is configured to be a TLS endpoint and '''proxy_pass''' to '''localhost:3000'''. Certificates are managed by the EFF's [https://certbot.eff.org certbot] and issued by [https://letsencrypt.org/ Let's Encrypt].

	====firewalld====		====firewalld====

Tdaede at 23:39, 6 December 2016

2016-12-06T23:39:54Z

← Older revision		Revision as of 23:39, 6 December 2016
Line 1:		Line 1:
	[https://arewecompressedyet.com/ AreWeCompressedYet] is an automatic service for compressing videos with Daala and other codecs.		[https://arewecompressedyet.com/ AreWeCompressedYet] is an automatic service for compressing videos with AV1, VP9, Daala, Thor, and other codecs.

	It generates graphs using different metrics, to enable comparisons between different versions of ~~the Daala~~ source code.		It generates graphs using different metrics, to enable comparisons between different versions of codec source code.

	For bugs and enhancements, see its [https://github.com/tdaede/awcy/issues GitHub Issues] page.		For bugs and enhancements, see its [https://github.com/tdaede/awcy/issues GitHub Issues] page.
Line 20:		Line 20:

	==Internal tools==		==Internal tools==
	* rd_tool.py: ~~is the main script that controls~~ the AWCY ~~machines~~ and ~~gathers the results. It has~~ a ~~similar interface to rd_collect.sh in the Daala repository~~.		* rd_server.py: the backend server process.

			* rd_tool.py: an alternate way to invoke the same tests as rd_server.py, it's no longer maintained and may be broken. This was used by previous versions of AWCY, and can only run one test at a time.

	* metrics_gather.sh: A script called by rd_tool.py, contains the command line parameters for all testable codecs.		* metrics_gather.sh: A script called by rd_tool.py, contains the command line parameters for all testable codecs.
Line 27:		Line 29:
	For an explanation of AWCY's metrics output format, see the '''[[RD_Curve_Data_Format]]''' page.		For an explanation of AWCY's metrics output format, see the '''[[RD_Curve_Data_Format]]''' page.

	==~~Machine~~==		==Maintenance==
	The server is a CentOS 7 virtual machine running on catfish.xiph.org. There are few config file changes, so the CentOS machine should be easily upgradeable to get security fixes.		The server is a CentOS 7 virtual machine running on catfish.xiph.org. There are few config file changes, so the CentOS machine should be easily upgradeable to get security fixes.

Line 34:		Line 36:
	====awcy====		====awcy====
	The AWCY server has a unit file at '''/etc/systemd/system/awcy.service'''. It listens at '''localhost:3000'''.		The AWCY server has a unit file at '''/etc/systemd/system/awcy.service'''. It listens at '''localhost:3000'''.

			====rd_server====
			The backend has a unit file at '''/etc/systemd/system/rdserver.service'''. It listens at '''localhost:4000'''. It currently has no authentication and should not be exposed to the Internet.

	====nginx====		====nginx====
	NGINX is configured to be a TLS endpoint and proxy_pass to localhost:3000.		NGINX is configured to be a TLS endpoint and proxy_pass to localhost:3000. Certificates are managed by certbot and issued by Let's Encrypt.

	====firewalld====		====firewalld====
			Firewalld is configured to allow ports 22, 80, and 443 only.

	====chrony====		====chrony====
Line 46:		Line 52:
	See AWCY logs with		See AWCY logs with
	journalctl -u awcy.service		journalctl -u awcy.service
			and
			journalctl -u rdserver.service

	===Directory Structure===		===Directory Structure===

Tdaede at 23:33, 6 December 2016

2016-12-06T23:33:52Z

← Older revision		Revision as of 23:33, 6 December 2016
Line 4:		Line 4:

	For bugs and enhancements, see its [https://github.com/tdaede/awcy/issues GitHub Issues] page.		For bugs and enhancements, see its [https://github.com/tdaede/awcy/issues GitHub Issues] page.

			==Repos==
			https://github.com/tdaede/awcy

			https://github.com/tdaede/rd_tool

	==Command-line tools==		==Command-line tools==
Line 13:		Line 18:

	By default, the prefix used for the run is your local branch name.		By default, the prefix used for the run is your local branch name.

	~~==Repos==~~
	~~https://github.com/tdaede/awcy~~

	~~https://github.com/tdaede/rd_tool~~

	==Internal tools==		==Internal tools==

MrZeus: /* Internal tools */

2016-11-15T11:44:48Z

Internal tools

← Older revision		Revision as of 11:44, 15 November 2016
Line 23:		Line 23:

	* metrics_gather.sh: A script called by rd_tool.py, contains the command line parameters for all testable codecs.		* metrics_gather.sh: A script called by rd_tool.py, contains the command line parameters for all testable codecs.

			== Output Format ==
			For an explanation of AWCY's metrics output format, see the '''[[RD_Curve_Data_Format]]''' page.

	==Machine==		==Machine==

Tdaede at 20:07, 17 February 2015

2015-02-17T20:07:06Z

← Older revision		Revision as of 20:07, 17 February 2015
Line 18:		Line 18:

	https://github.com/tdaede/rd_tool		https://github.com/tdaede/rd_tool

			==Internal tools==
			* rd_tool.py: is the main script that controls the AWCY machines and gathers the results. It has a similar interface to rd_collect.sh in the Daala repository.

			* metrics_gather.sh: A script called by rd_tool.py, contains the command line parameters for all testable codecs.

	==Machine==		==Machine==

MrZeus: /* Files not part of github repo */

2015-02-08T22:40:54Z

Files not part of github repo

← Older revision		Revision as of 22:40, 8 February 2015
Line 59:		Line 59:

	===Files not part of github repo===		===Files not part of github repo===
	node_modules: created by npm when you install the necessary node modules to run awcy_server.js.		* node_modules: created by npm when you install the necessary node modules to run awcy_server.js.
	daala.pem: Private SSH key used to connect to the AWS instances.		* daala.pem: Private SSH key used to connect to the AWS instances.
	daalatool: A local clone of Daala, used for the contents of the tools/ directory.		* daalatool: A local clone of Daala, used for the contents of the tools/ directory.
	secret_key: File containing the secret key used on the main website.		* secret_key: File containing the secret key used on the main website.
	config.json: Contains IRC channel to connect to. TODO: put secret_key and other stuff in here too.		* config.json: Contains IRC channel to connect to. TODO: put secret_key and other stuff in here too.

	rd_tool/daala.pem: same file as in higher level directory		* rd_tool/daala.pem: same file as in higher level directory