6/21/2017 7:52:23 PM
(#1235)
Azkaban currently uses `HiveMetaStoreClient` while communicating with the Hive Metastore ref class: `HadoopSecurityManager_H_2_0`
This client does not automatically retry/reconnect in case of transient failures, such as when a metastore is restarted. The RetryingHiveMetaStoreClient does automatically retry/reconnect in case of errors.
This change switches it to use the RetryingHiveMetaStoreClient (which is what the Hive CliDriver uses internally).
NOTE: This introduces a runtime dependency on `hive-exec` core jar. Currently, this is set as a compile only dependency in Azkaban but it actually requires this jar in the runtime and expects to get it from the `HIVE_HOME` environment variable.
Ref: https://github.com/linkedin/gobblin/issues/1506
|
6/21/2017 2:21:57 PM
SaveAction, which was disabled for prior PR. No other changes made.
|
|
|
6/20/2017 3:52:44 PM
(#1240)
http://errorprone.info/bugpattern/DoubleCheckedLocking
Collaborated with @suvodeep-pyne
|
6/20/2017 3:45:09 PM
with @suvodeep-pyne This class will be deprecated in the future as the code is transitioned to full guice.
|
6/20/2017 10:27:18 AM
class (#1236)
Step 2 of refactoring the log4j appender logic
Use Idea's refactoring tool only to do this.
|
6/19/2017 8:06:23 PM
the generated result.
Upgrading to gradle 4.0 seems to generate the same result.
|
6/19/2017 7:56:09 PM
add the build-dashboard plugin
see https://docs.gradle.org/current/userguide/buildDashboard_plugin.html
testing:
ruyang-mn1:azkaban ruyang$ ./gradlew azkaban-exe-server:dependencyReport
Parallel execution with configuration on demand is an incubating feature.
:azkaban-exec-server:dependencyReport
See the report at: file:///Users/ruyang/oss/azkaban/azkaban-exec-server/build/reports/project/dependencies.txt
BUILD SUCCESSFUL
|
6/19/2017 5:23:33 PM
test time from 15 seconds to 12 seconds on my mac.
./gradlew azkaban-common:cleanTest azkaban-common:test
I expect the reduction will be more significant on travis.
See
http://mrhaki.blogspot.com/2010/11/gradle-goodness-running-tests-in.html
https://docs.gradle.org/current/dsl/org.gradle.api.tasks.testing.Test.html
https://docs.gradle.org/current/userguide/java_plugin.html#sec:test_execution
|
6/19/2017 3:35:10 PM
IntelliJ's automatic equals/hashcode creator.
|
