12/18/2017 7:12:17 PM
3.38.2
hard linking (#1583)
Linux has restriction on shell argument length, it's likely the command to do hard linking project dir of a lot of subdir and files will exceed the restriction, causing flow setup failure. The fix is replacing the logic with java native file API.
|
11/15/2017 8:59:58 PM
3.38.1
provider (#1556)
* commit 1
* commit 2
* remove redundant code
This PR is a follow-up of #1552 . We create a job setting "azkaban.job.enable.ssl". When it is enabled, we use Java reflection to initialize the credential provider object, and run the method.
|
11/7/2017 5:30:49 PM
3.38.0
Interface in order to let custom credential provider register user's secret keys.
One sample use case: Today we don't have a secure way to pass on credentials into Hadoop. This interface allows Azkaban to fetch user's credential from external system (like certificate authority), and add it into Hadoop Job Context. Then submitted hadoop job will be able to use it.
Today we only have one method, but could have more in future.
This PR only proposes an interface, and the next step will be to use this interface in HadoopSecurityManager_H_2_0 class.
|
|
|
10/26/2017 6:54:08 PM
(#1543)
This PR consolidates some methods of initialization of ExecutableFlow which used in multiple places into common static util methods.
The motivation is to let flow trigger leverage those method to start an executable flow(#1526).
Also changed the azkaban.utils.TestUtils#createExecutableFlow to azkaban.utils.TestUtils#createTestExecutableFlow to avoid name duplication.
|
10/25/2017 9:30:38 PM
Create project_flow_files DB table.
* Address comments.
|
10/23/2017 11:15:56 PM
YAML file. (#1534)
* Flow 2.0 design - Convert AzkabanFlow to Flow. Load project YAML file.
* Address comments.
* Address comments.
* Consolidate test case.
* Add test cases.
|
10/20/2017 8:41:29 PM
dependencies (#1540)
We recently found Quartz jobs cannot easily inject a dependency. The previously proposal was to add dependencies into Context of Quartz Job. However, it is not recommended, the correct approach is to only inject String or very light weight objects into context. Besides, it increased more complexity for users to leverage Quartz. In this PR, we create a Quartz Job Factory, which is able to seamlessly provide any dependency inside web server.
|
10/13/2017 12:22:29 PM
3.37.0
tests (#1536)
|
10/12/2017 9:22:25 PM
(#1533)
|
