6/19/2017 7:56:09 PM
add the build-dashboard plugin
see https://docs.gradle.org/current/userguide/buildDashboard_plugin.html
testing:
ruyang-mn1:azkaban ruyang$ ./gradlew azkaban-exe-server:dependencyReport
Parallel execution with configuration on demand is an incubating feature.
:azkaban-exec-server:dependencyReport
See the report at: file:///Users/ruyang/oss/azkaban/azkaban-exec-server/build/reports/project/dependencies.txt
BUILD SUCCESSFUL
|
6/19/2017 5:23:33 PM
test time from 15 seconds to 12 seconds on my mac.
./gradlew azkaban-common:cleanTest azkaban-common:test
I expect the reduction will be more significant on travis.
See
http://mrhaki.blogspot.com/2010/11/gradle-goodness-running-tests-in.html
https://docs.gradle.org/current/dsl/org.gradle.api.tasks.testing.Test.html
https://docs.gradle.org/current/userguide/java_plugin.html#sec:test_execution
|
6/19/2017 3:35:10 PM
IntelliJ's automatic equals/hashcode creator.
|
|
|
6/19/2017 3:05:42 PM
> 5 seconds of test time.
The triggermanager code is scheduled to be removed soon. It's not
worth fixing these tests. We will avoid changing these classes and if we have to, the person has to run these tests manually.
|
6/19/2017 2:32:00 PM
1 of refactoring the log4j appender logic
Use Idea's refactoring tool only to do this.
|
6/13/2017 8:34:04 PM
3.29.0
authorizing prior to any HDFS call, the HDFS storage code does not seem to work without an existing Kerberos session. The problem is that the `FileSystem.get()` API needs to be called after a successful UGI login. Currently that is not the case. The Hadoop code caches the logged in user at the time of creating the File System object and this is not reflected in the stack traces making it difficult to debug.
Fix: ensure UGI auth prior to creation of file system object.
|
6/13/2017 1:58:54 AM
time (PR #1207) I only did this for waitForStatus(), while I should've caught these all.
- Additional stability even is test runner is slow (like supposedly on Travis sometimes)
- This doesn't make the tests any slower than before, as long as they pass
|
6/12/2017 9:48:50 PM
suggests "@SuppressWarnings("unused")" when compiling, but this did not appear to remove the warning.
Following the recommendation suggested in the link above and adding "@SuppressWarnings("FutureReturnValueIgnored")" seemed to do the trick.
|
6/12/2017 9:35:31 PM
(#1197)
* Fix deprecated api compiler warnings in HadoopSecurityManager_H_2_0
Warning:(446, 20) java: cancelDelegationToken(org.apache.hadoop.security.token.Token<org.apache.hadoop.mapreduce.security.token.delegation.DelegationTokenIdentifier>) in org.apache.hadoop.mapred.JobClient has been deprecated
Fixed by removing the now unused private methods.
Also corrected the log messages.
Todo: I can't find the history that explains why these token cancellation requests were ignored. It appears that that code change was made at least 2-3 years ago. We haven't seen reports of related issues yet. There is no good reason to take the risk to re-introduce the logic now.
|
