9/28/2017 9:36:47 PM
and Dependency are two immutable classes holding the trigger/dependency configuration and parameters. They will be constructed from trigger config files. Once created, they couldn't be modified.
Class constructors will also perform following validations:
check all required parameters are there.
no duplicate dependency name across same trigger's dependencies.
no duplicate dependency parameters across same trigger's dependencies(different name same other parameters).
|
9/26/2017 8:30:36 PM
writable by user process (#1504)
JOB_OUTPUT_PROP_FILE is a file used to pass properties between jobs. You can read about it here: http://azkaban.github.io/azkaban/docs/latest/#job-configuration
#1325 introduced a regression where JOB_OUTPUT_PROP_FILE became no longer writable due to an upgraded execute-as-user executable that stopped user processes from having the azkaban group permission. This file needs to be written to so properties can be passed from one job to another.
This fix assigns ownership of JOB_OUTPUT_PROP_FILE and JOB_PROP_FILE to <username>:azkaban to guarantee user ability to write to this file. It is uncertain whether or not JOB_PROP_FILE is intended to be written to, but I believe it's a good idea to do allow it to be in order to prevent regressions.
This is covered by an integration test that simply tries to write to the JOB_OUTPUT_PROP_FILE to confirm that it is doable. This is already in master of azkaban-auto-test.
This change will more drastically take effect when the execute-as-user executable is upgraded to its newest version.
This was tested on solo-server and holdem4.
I'll continue to explore JOB_OUTPUT_PROP_FILE and JOB_PROP_FILE usage and implementation so we can make sure these features are fully covered by tests and can be leveraged successfully by our users.
|
9/22/2017 8:42:25 PM
3.35.0
in build.gradle (#1503)
|
9/21/2017 9:36:00 PM
build: change hadoop gradle dependencies to compileOnly instead of incuding them as runtime dependencies
* Fix tests broken due to moving to compileOnly for hadoop dependencies.
Fix was to use testCompile to include hadoop dependencies.
Also fixed transitive dependencies from gobblinKafka dependency
|
9/21/2017 8:06:42 PM
H2FileDataSource and MySQLDataSource should be singleton. The reason behind is that We would like all database operations to share the same connection pool to guarantee performance.
Besides, removing singleton from DatabaseOperator as no states exist there. It is safe to have multiple DatabaseOperator instances.
|
9/21/2017 4:01:57 PM
project
* Save action formatting change
* Address comments
* Address comments
|
9/21/2017 2:20:25 PM
dialog (#1493)
Fix duplicate properties in flow execution and job edit when dialog is closed and reopened.
|
9/20/2017 9:21:14 PM
(#1494)
|
9/20/2017 4:07:55 PM
already the e-mail title will tell which a) job level SLA, or b) flow level SLA, was triggered.
|
9/19/2017 6:16:56 PM
status was missing color in the UI, so add it.
The issue #1451 has some further details.
|
