2/22/2018 6:56:27 PM
(#1656)
Today toProperties in Props API doesn't include parent properties. In this PR, we add an API to import both current and parent properties.
Tested locally.
|
2/22/2018 3:19:52 AM
to allow users to debug credential issues easily, this PR proposes adding job logger into the credential instance, so that related log messages will be shown in Azkaban web UI.
Notice that this PR is backward compatible. In the credential client code side, we have both 2-parameter and 3-parameter constructor. If we need to roll back this commit, it will not fail.
|
2/21/2018 10:43:25 PM
finished flows (#1643)
This PR fixes the bug which includes trigger Instances in cancelling state into recently finished flows.
|
2/21/2018 4:44:39 PM
scheduled flow trigger
AZ_WEB_SERVER_URL:AZ_WEB_SERVER_PORT/flowtrigger
|
2/20/2018 4:57:06 PM
showing flow trigger properties in flow trigger instance UI.
|
2/16/2018 9:16:14 PM
(#1646)
flow trigger service needs to be started first before scheduler starts to schedule existing flow triggers. This PR puts starting flow trigger service before starting flow trigger scheduler and adds more logging when starting flow trigger service/scheduler.
|
2/16/2018 9:15:28 PM
changes:
* Originally we use getFifteenMinuteRate to get transform meter to gauge. 15 mins was too large, and we'd better change it to 1 minute window to reduce smoothing effect
* Adding database transaction metrics if database throws an exception during the query phase.
Tested in the staging environment.
|
2/16/2018 8:49:32 PM
a series of enhancement to FlowTriggerService:
handle the case where flow trigger without dependencies is a regular schedule without waiting for data, so the trigger instance will be processed as succeed once created.
removes some extra log to be conciser.
replace removeRunningTriggerInstById method with this.runningTriggers.remove()
increase the unit test coverage of flow trigger service.
|
2/16/2018 7:28:44 PM
class around QuartzScheduler - FlowTriggerScheduler.
The class provides
schedule all flows in a project with flow trigger defined with quarz scheduler.
unscheduleAll all flows in a project with flow trigger defined with quartz scheduler.
Retrieve the list of current flow schedules from quartz database.
FlowTriggerScheduler will be used to schedule/unschedule flows if schedule is part of flow configuration file(flow 2.0) when project is uploaded/deleted.
Also when flow trigger is defined, thus schedule is part of flow config, scheduling those flows from UI/API is disallowed.
Tested via manual uploading a project with flow trigger but unit test of this part is a bit tricky, will add unit test if possible or verify in integration test.
|
|
|
