Building Spark 1.5.2 - Maven heap space issue - java

I am building Apache Spark with the make-distribution.sh script. It works fine till the spark-streaming-mqtt_2.10 module.
My MAVEN_OPTS environment variable is:
export MAVEN_OPTS="-Xmx15g -XX:MaxPermSize=15000M -XX:ReservedCodeCacheSize=15000M"
Even though the memory assigned to Maven is very high, it still fails in the creation of spark-streaming-mqtt-test-1.5.2.jar jar file.
Below is the error stacktrace:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (test-jar-with-dependencies) on project spark-streaming-mqtt_2.10: Failed to create assembly: Error creating assembly archive test-jar-with-dependencies: Problem creating jar: Execution exception: Java heap space -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :spark-streaming-mqtt_2.10

Related

Build Failure with maven sure fire plugin error on Jenkins: The forked VM terminated without properly saying goodbye. VM crash or System.exit called?

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project HawthorneEffectAutomation: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /var/lib/jenkins/workspace/HE_HQ_Automaton && /usr/lib/jvm/java-11-openjdk-11.0.13.0.8-1.amzn2.0.3.x86_64/bin/java -jar /var/lib/jenkins/workspace/HE_HQ_Automaton/target/surefire/surefirebooter14653655313054336893.jar /var/lib/jenkins/workspace/HE_HQ_Automaton/target/surefire/surefire15702145916035405804tmp /var/lib/jenkins/workspace/HE_HQ_Automaton/target/surefire/surefire_083360849272140865tmp
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[JENKINS] Archiving /var/lib/jenkins/workspace/HE_HQ_Automaton/pom.xml to org.example/HawthorneEffectAutomation/1.0-SNAPSHOT/HawthorneEffectAutomation-1.0-SNAPSHOT.pom
channel stopped
[CucumberReport] Using Cucumber Reports version 5.7.1
[CucumberReport] JSON report directory is ""
[CucumberReport] Copied 8 properties files from workspace "/var/lib/jenkins/workspace/HE_HQ_Automaton" to reports directory "/var/lib/jenkins/jobs/HE_HQ_Automaton/builds/143/cucumber-html-reports/.cache"
[CucumberReport] Copied 2 files from workspace "/var/lib/jenkins/workspace/HE_HQ_Automaton" to reports directory "/var/lib/jenkins/jobs/HE_HQ_Automaton/builds/143/cucumber-html-reports/.cache"
[CucumberReport] Processing 2 json files:
[CucumberReport] /var/lib/jenkins/jobs/HE_HQ_Automaton/builds/143/cucumber-html-reports/.cache/target/cucumber-reports/report.json
[CucumberReport] /var/lib/jenkins/jobs/HE_HQ_Automaton/builds/143/cucumber-html-reports/.cache/target/cucumber.json
[CucumberReport] Missing report result - the report was not successfully completed
[CucumberReport] Build status is left unchanged
Finished: FAILURE
I did check the plugin version and dependency version and all are up to date and matching with each other

How To Solve Netbeans Error Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (default-cli)

Here is the error i get when i try to run my netbeans,Normally it worked before on my laptop, of rencent it stop working and giving me this error.
Here Is the error i get when i try to run my program
Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (default-cli) on project mavenproject1: Command execution failed. Process exited with an error: 1 (Exit value: 1) -> [Help 1]
To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.
For more information about the errors and possible solutions, please read the following articles:
[Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Deployment to JBoss/WildFly 8 fails with Java heap space

My Jenkins build fails sometimes while deploying to JBoss/WildFly 8 with Java heap space problem.
[ERROR] Failed to execute goal org.wildfly.plugins:wildfly-maven-plugin:1.1.0.Alpha2:deploy (default-cli) on project Prometheus: Deployment failed: Operation failed: "JBAS014749: Operation handler failed: Java heap space" -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
I have to restart my JBoss/WildFly every time this happens to deploy to server. Please help me in clearing the problem so that it doesn't hinder my automation.

Maven compiler plugin error v3.0.3

I am new to maven installation. While executing a .bat file which installs maven, I am getting the below error. Could you please check :
Launching environment tests
checking Java 4 compile, java 4 run
[ERROR] COMPILATION ERROR :
[ERROR] Failure executing javac, but could not parse the error:
The system cannot find the path specified.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default
-compile) on project devenv-validate: Compilation failure
[ERROR] Failure executing javac, but could not parse the error:
[ERROR] The system cannot find the path specified.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following arti
cles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
checking Java 4 compile, java 6 run
[ERROR] COMPILATION ERROR :
[ERROR] Failure executing javac, but could not parse the error:
The system cannot find the path specified.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default
-compile) on project devenv-validate: Compilation failure
[ERROR] Failure executing javac, but could not parse the error:
[ERROR] The system cannot find the path specified.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following arti
cles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
checking Java 6 compile, java 6 run
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running TestDevEnvValidator
Java version : Actual [1.6.0_20], expected [1.6.0_20]
Java compiler : Actual [6], expected [6]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Results :
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
Press any key to continue . . .
Can anyone please have a look and say why it is failing. Thanks in advance.

The system cannot find the path specified.
If you are using Windows, please check if the path specified for system variables: Path, JAVA_HOME, M2_HOME, M2.
Check out this tutorial:
http://www.tutorialspoint.com/maven/maven_environment_setup.htm

Unable to stream twitter data using storm

I am following the steps as per the Kantega/storm-twitter-workshop project link
but I am stuck at a point. While testing credentials by running the main class in folder cheating
cd cheating
mvn compile exec:java -Dexec.classpathScope=compile -Dexec.mainClass=storm.starter.CheatingTwitterFunTopology
I am getting the below error:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.0.2:compile (default-compile) on project storm-assignment-solution: Compilation failure
[ERROR] Unable to locate the Javac Compiler in:
[ERROR] /usr/lib/jvm/java-7-openjdk-amd64/jre/../lib/tools.jar
[ERROR] Please ensure you are using JDK 1.4 or above and
[ERROR] not a JRE (the com.sun.tools.javac.Main class is required).
[ERROR] In most cases you can change the location of your Java
[ERROR] installation by setting the JAVA_HOME environment variable.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
Where am I going wrong?

The Error says it all ..
[ERROR] Unable to locate the Javac Compiler in:[ERROR] /usr/lib/jvm/java-7-openjdk-amd64/jre/../lib/tools.jar
[ERROR] Please ensure you are using JDK 1.4 or above and
Looking at your project page found the following
1) It uses 2 maven modules namely cheating and storm-assignment and both of them are expected to run under Java 1.6 as found in their pom.xml
Check the pom.xml for both the module has this
<configuration>
<source>1.6</source>
<target>1.6</target>
</configuration>
Make sure you are running with atleast Java 1.6 or Higher

Categories