5/3/2017 8:40:33 PM
3.22.0
String is more generic and gives flexibility to the storage implementation to structure their own keys.
For example, the storage layer may use a JSON string as an identifier. This is not currently a use case, but going forward it would probably be better to not impose an unnecessary restriction on a top level API.
Tested separately on dev clusters.
|
5/3/2017 7:07:56 PM
Simplify the logic for getting system memory information
There is no need to gather the information in a separate thread.
It's simpler just to read the file every time.
Switched to Guice to construct these classes.
Added unit tests.
Switched MEM_KEYS from array to ImmutableSet.
Changed some logging to error level from warning level since they are
unexpected conditions.
* Initialize SERVICE_PROVIDER in tests that need it
* Check if the /proc/meminfo file is readable in test
This is done to see it will fix the strange test failure in Travis.
* Disable a getOsTotalFreeMemorySize test to get around the Travis test failure
|
5/3/2017 2:49:22 PM
sql files from azkaban-sql to azkaban-db
This patch consolidate the azkaban-sql and azkaban-db modules into one place. Basically we move sql files from azkaban-sql into `azkaban-db/src/main/sql`. Tested by `gradle build`. Also, these files is able to appear in the right place (Distribution zip) after `gradle installDist`.
|
5/3/2017 2:38:42 PM
tests for ExecutorManager and JdbcExecutorLoader. (#1048)
|
5/3/2017 1:36:21 PM
modules (#1053)
This allows loggers that use slf4j to log properly.
Also added log4j.properties files to test resources to log to console
in tests by default.
Testing:
Here is the console output from running a test
2017/05/03 08:35:08.586 -0700 ERROR [DatabaseOperatorImpl] query failed
java.sql.SQLException
|
5/2/2017 10:22:26 PM
PR #1024 introduces a new column to 'project_versions' table
|
5/2/2017 7:36:33 PM
3.21.0
(#1049)
This is required by the internal build system and it needs to be fixed
prior to clean up of this code
|
5/1/2017 9:52:20 PM
Refactor the code for getting OS free memory information
Replaced SwapCache with SwapFree
See https://bbs.archlinux.org/viewtopic.php?id=133604
SwapCache doesn't represent the available swap space.
Switched the logger to lsf4j.
Will make another pull request to switch to Guice.
Fixed all the intellij and ErrorProne warnings.
* Fix [FutureReturnValueIgnored] errorprone warning
|
5/1/2017 2:43:48 PM
(#1044)
@RunWith(Suite.class)
@SuiteClasses({ JavaProcessJobTest.class, ProcessJobTest.class, PythonJobTest.class })
|
5/1/2017 1:07:05 PM
(#1045)
Warnings:
azkaban/azkaban-common/src/test/java/azkaban/jobExecutor/WordCountLocal.java:59: warning: [DefaultCharset] Implicit use of the platform default charset, which can result in e.g. non-ASCII characters being silently replaced with '?' in many environments new BufferedReader(new InputStreamReader(new FileInputStream(_input))); ^ (see http://errorprone.info/bugpattern/DefaultCharset) Did you mean 'new BufferedReader(new InputStreamReader(new FileInputStream(_input), UTF_8));' or 'new BufferedReader(new InputStreamReader(new FileInputStream(_input), Charset.defaultCharset()));'?
azkaban/azkaban-common/src/test/java/azkaban/jobExecutor/WordCountLocal.java:83: warning: [DefaultCharset] Implicit use of the platform default charset, which can result in e.g. non-ASCII characters being silently replaced with '?' in many environments PrintWriter out = new PrintWriter(new FileOutputStream(_output)); ^ (see http://errorprone.info/bugpattern/DefaultCharset)
Also fixed:
Intellij warnings
Removed two unnecessary override methods.
Renamed local variables to confirm to the coding standard.
|
