TestContainers Could not find a valid Docker environment - java

Running the same version of TestContainers 1.15.3 in one project is working correctly detecting docker etc but in another it is unable to start due to some sort of signing issue?
2021-08-23 20:35:13.524 INFO [,,,] 49733 --- [ers-lifecycle-0] .t.d.DockerMachineClientProviderStrategy : docker-machine executable was not found on PATH ([/usr/local/bin, /usr/bin, /bin, /usr/sbin, /sbin, /usr/local/bin])
2021-08-23 20:35:14.104 ERROR [,,,] 49733 --- [ers-lifecycle-0] o.t.d.DockerClientProviderStrategy : Could not find a valid Docker environment. Please check configuration. Attempted configurations were:
2021-08-23 20:35:14.105 ERROR [,,,] 49733 --- [ers-lifecycle-0] o.t.d.DockerClientProviderStrategy : UnixSocketClientProviderStrategy: failed with exception RuntimeException (java.lang.UnsatisfiedLinkError: /private/var/folders/vr/3wn83fp91j58p74ymdrghq480000gq/T/jna--2036694134/jna17985952756996537821.tmp: dlopen(/private/var/folders/vr/3wn83fp91j58p74ymdrghq480000gq/T/jna--2036694134/jna17985952756996537821.tmp, 1): no suitable image found. Did find:
/private/var/folders/vr/3wn83fp91j58p74ymdrghq480000gq/T/jna--2036694134/jna17985952756996537821.tmp: code signature in (/private/var/folders/vr/3wn83fp91j58p74ymdrghq480000gq/T/jna--2036694134/jna17985952756996537821.tmp) not valid for use in process using Library Validation: mapped file has no cdhash, completely unsigned? Code has to be at least ad-hoc signed.). Root cause UnsatisfiedLinkError (/private/var/folders/vr/3wn83fp91j58p74ymdrghq480000gq/T/jna--2036694134/jna17985952756996537821.tmp: dlopen(/private/var/folders/vr/3wn83fp91j58p74ymdrghq480000gq/T/jna--2036694134/jna17985952756996537821.tmp, 1): no suitable image found. Did find:
/private/var/folders/vr/3wn83fp91j58p74ymdrghq480000gq/T/jna--2036694134/jna17985952756996537821.tmp: code signature in (/private/var/folders/vr/3wn83fp91j58p74ymdrghq480000gq/T/jna--2036694134/jna17985952756996537821.tmp) not valid for use in process using Library Validation: mapped file has no cdhash, completely unsigned? Code has to be at least ad-hoc signed.)
2021-08-23 20:35:14.105 ERROR [,,,] 49733 --- [ers-lifecycle-0] o.t.d.DockerClientProviderStrategy : As no valid configuration was found, execution cannot continue
JDK:
brew info adoptopenjdk12
adoptopenjdk12: 12.0.2,10
https://adoptopenjdk.net/
/usr/local/Caskroom/adoptopenjdk12/12.0.2,10 (190MB)
From: https://github.com/adoptopenjdk/homebrew-openjdk/blob/HEAD/Casks/adoptopenjdk12.rb
==> Name
AdoptOpenJDK 12
==> Description
AdoptOpenJDK OpenJDK (Java) Development Kit
==> Artifacts
OpenJDK12U-jdk_x64_mac_hotspot_12.0.2_10.pkg (Pkg)
Working project:
2021-08-23 20:18:23.586 INFO [,,] 47914 --- [ers-lifecycle-0] o.t.d.DockerClientProviderStrategy : Loaded org.testcontainers.dockerclient.UnixSocketClientProviderStrategy from ~/.testcontainers.properties, will try it first
2021-08-23 20:18:24.154 INFO [,,] 47914 --- [ers-lifecycle-0] o.t.d.DockerClientProviderStrategy : Found Docker environment with local Unix socket (unix:///var/run/docker.sock)
2021-08-23 20:18:24.156 INFO [,,] 47914 --- [ers-lifecycle-0] org.testcontainers.DockerClientFactory : Docker host IP address is localhost
2021-08-23 20:18:24.198 INFO [,,] 47914 --- [ers-lifecycle-0] org.testcontainers.DockerClientFactory : Connected to docker:
Server Version: 20.10.7
API Version: 1.41
Operating System: Docker Desktop
Total Memory: 5945 MB
JDK:
java --version
openjdk 16.0.2 2021-07-20
OpenJDK Runtime Environment (build 16.0.2+7-67)
OpenJDK 64-Bit Server VM (build 16.0.2+7-67, mixed mode, sharing)
Any pointers greatly appreciated.
Mac OS Big Sur
Docker Desktop Version 3.5.2 (3.5.2.18)

This looks to be caused by an issue in Adopt Open JDK as documented here:
https://github.com/adoptium/temurin-build/issues/1211#issuecomment-521392147
github.com/testcontainers/testcontainers-java/issues/1773
Switching over to Oracle JDK 12 has resolved the issue.

Related

SonarQube stopped and is not running

I'm trying to setup SonarQube 7.8 version. Once i start sonar.sh file it is running but after that sonar stops.
root#automation:/opt/sonarqube-7.8/bin/linux-x86-64# ./sonar.sh start
Starting SonarQube...
Started SonarQube.
root#automation:/opt/sonarqube-7.8/bin/linux-x86-64# ./sonar.sh status
SonarQube is not running.
I checked the logs and this is what i get:
--> Wrapper Started as Daemon
Launching a JVM...
Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
Copyright 1999-2006 Tanuki Software, Inc. All Rights Reserved.
2019.10.15 21:01:37 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /opt/sonarqube-7.8/temp
2019.10.15 21:01:37 INFO app[][o.s.a.es.EsSettings] Elasticsearch listening on /127.0.0.1:9001
2019.10.15 21:01:37 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='es', ipcIndex=1, logFilenamePrefix=es]] from [/opt/sonarqube-7.8/elasticsearch]: /opt/sonarqube-7.8/elasticsearch/bin/elasticsearch
2019.10.15 21:01:37 INFO app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2019.10.15 21:01:38 INFO app[][o.e.p.PluginsService] no modules loaded
2019.10.15 21:01:38 INFO app[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.transport.Netty4Plugin]
Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
2019.10.15 21:01:41 WARN app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [es]: 1
2019.10.15 21:01:41 INFO app[][o.s.a.SchedulerImpl] Process[es] is stopped
2019.10.15 21:01:41 INFO app[][o.s.a.SchedulerImpl] SonarQube is stopped
<-- Wrapper Stopped
es.log file is here :
2019.10.15 21:01:41 ERROR es[][o.e.b.Bootstrap] Exception
java.lang.RuntimeException: can not run elasticsearch as root
at org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:103) ~[elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:170) ~[elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:333) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) [elasticsearch-cli-6.8.0.jar:6.8.0]
at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:116) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) [elasticsearch-6.8.0.jar:6.8.0]
I'm not sure why SonarQube stops. Could you help me with that please?
SOLVED:
First, don't run sonarqube as the root user
Create user
command: useradd username (put username as sonaradmin(if you don't want to change any command)
Create a password command: passwd username
goto /opt/ directory
3.1) Rename sonarqube.x.x.x to sonarqube command:sudo mv sonarqube.x.x.x sonarqube(X.X.X you should change directory name)
Change permissions command:chmod 775 -R sonarqube(folder name may change Sonarqube )
Add Created user to sonaradmin group command: chown -R sonaradmin:sonaradmin sonarqube
goto : cd /opt/sonarqube/bin/linux-x86-64/
Command: su sonaradmin
Enter password
command:./sonar.sh start
Command:./sonar.sh status
Now goto browser check http://localhost:9000/sonar
Hoping this helps.... I have gone through the same issue,solved
ok, i found the solution. All i had to do is to change #RUN_AS_USER= in /opt/sonarqube-7.8/bin/linux-x86-64/sonar.sh line 48 to RUN_AS_USER=sonar
Your solution for me doesn't works, cause console show me this messagge (after edit to sonar.sh file)
groups: "sonar": no such user
chown: utente non valido: "sonar:sonar"
su: user sonar does not exist
if baya prakash reddy's answer doesn't work, so you can look at the documentation https://docs.sonarqube.org/latest/requirements/requirements/ where it says that you must ensure that:
vm.max_map_count is greater than or equal to 524288
yo can set it like this:
sysctl -w vm.max_map_count=524288
Ensure your sonarQube server has at least 4GB of RAM. I had this issue after installing SonarQube with 1GB of RAM. Running SonarQube as sonar did not resolve the issue. Once I installed on RHL with 4GB RAM, issue was resolved

Sonarqube 7.9.1 refuses to start after an upgrade from 6.7.7

The previous version of SQ was 6.7.7 LTS, so i upgraded to 7.9.1 LTS.
I installed a new JDK
java version "11.0.4" 2019-07-16 LTS
Java(TM) SE Runtime Environment 18.9 (build 11.0.4+10-LTS)
Java HotSpot(TM) 64-Bit Server VM 18.9 (build 11.0.4+10-LTS, mixed mode)
but still SQ stopped.
This is a snippet of the sonar.log
2019.08.01 14:50:19 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /data/sonarqube/sonarqube-7.9.1/temp
2019.08.01 14:50:19 INFO app[][o.s.a.es.EsSettings] Elasticsearch listening on /127.0.0.1:9001
2019.08.01 14:50:19 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='es', ipcIndex=1, logFilenamePrefix=es]] from [/data/sonarqube/sonarqube-7.9.1/elasticsearch]: /data/sonarqube/sonarqube-````7.9.1/elasticsearch/bin/elasticsearch
2019.08.01 14:50:19 INFO app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
2019.08.01 14:50:20 INFO app[][o.e.p.PluginsService] no modules loaded
2019.08.01 14:50:20 INFO app[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.transport.Netty4Plugin]
2019.08.01 14:50:22 WARN app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [es]: 1
2019.08.01 14:50:22 INFO app[][o.s.a.SchedulerImpl] Process[es] is stopped
2019.08.01 14:50:22 INFO app[][o.s.a.SchedulerImpl] SonarQube is stopped
2019.08.01 14:50:22 INFO app[][o.e.c.t.TransportClientNodesService] failed to get node info for {#transport#-1}{GK1cYpSNTM-eycINcVQsOA}{127.0.0.1}{127.0.0.1:9001}, disconnecting...
java.lang.IllegalStateException: Future got interrupted
and a snippet of es.log
2019.08.01 14:50:22 ERROR es[][o.e.b.Bootstrap] Exception
java.lang.RuntimeException: can not run elasticsearch as root
at org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:103) ~[elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:170) ~[elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:333) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) [elasticsearch-cli-6.8.0.jar:6.8.0]
at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:116) [elasticsearch-6.8.0.jar:6.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) [elasticsearch-6.8.0.jar:6.8.0]
of course i start SQ (and ES) with a non-root user. That’s why i don’t understand the error in es.log
I can't find the solution at all. Please can you help me?
With kind regards, William

Not able to start SonarCube server in MacOSx

Running the latest version of sonarcube 7.1.2 and getting the following error.:
Command executed: sudo ./sonar.sh
Wrapper Started as Console
Launching a JVM...
Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
Copyright 1999-2006 Tanuki Software, Inc. All Rights Reserved.
2018.07.01 18:36:05 INFO app[][o.s.a.AppFileSystem] Cleaning or
creating temp directory /Users/aneeshgoel/Downloads/sonarqube-7.2.1/temp
2018.07.01 18:36:05 INFO app[][o.s.a.es.EsSettings] Elasticsearch
listening on /127.0.0.1:9001
2018.07.01 18:36:05 INFO app[][o.s.a.p.ProcessLauncherImpl] Launch
process[[key='es', ipcIndex=1, logFilenamePrefix=es]] from
[/Users/aneeshgoel/Downloads/sonarqube-7.2.1/elasticsearch]:
/Users/aneeshgoel/Downloads/sonarqube-
7.2.1/elasticsearch/bin/elasticsearch -
Epath.conf=/Users/aneeshgoel/Downloads/sonarqube-7.2.1/temp/conf/es
2018.07.01 18:36:05 INFO app[][o.s.a.SchedulerImpl] Waiting for
Elasticsearch to be up and running
2018.07.01 18:36:10 INFO app[][o.e.p.PluginsService] no modules loaded
2018.07.01 18:36:10 INFO app[][o.e.p.PluginsService] loaded plugin
[org.elasticsearch.transport.Netty4Plugin]
2018.07.01 18:36:16 WARN app[][o.s.a.p.AbstractProcessMonitor] Process
exited with exit value [es]: 1
2018.07.01 18:36:16 INFO app[][o.s.a.SchedulerImpl] Process [es] is
stopped
2018.07.01 18:36:16 INFO app[][o.s.a.SchedulerImpl] SonarQube is
stopped
<-- Wrapper Stopped
Then I tried with non sudo user. Command ./sonar.sh
Error got is :
--> Wrapper Started as Console
Launching a JVM...
Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
Copyright 1999-2006 Tanuki Software, Inc. All Rights Reserved.
2018.07.01 18:18:16 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /Users/aneeshgoel/Downloads/sonarqube-7.2.1/temp
WrapperSimpleApp: Encountered an error running main: java.nio.file.AccessDeniedException: /Users/aneeshgoel/Downloads/sonarqube-7.2.1/temp/conf/es/elasticsearch.yml
java.nio.file.AccessDeniedException: /Users/aneeshgoel/Downloads/sonarqube-7.2.1/temp/conf/es/elasticsearch.yml
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.sonar.process.FileUtils2$DeleteRecursivelyFileVisitor.visitFile(FileUtils2.java:170)
I have tried giving write access also to the directory , but still no luck. Please can someone help in debugging the issue.
SonarQube installation guide, unfortunately, doesn’t say a thing about configuring user for the analysis server. People that are installing it can later forget about it, leaving SonarQube running with root rights for a while.
It is, however pretty simple and straightforward. Prepare sonar system user and change installation directory rights:
You have to run the sonar in the context of sonar user. To create a user called sonar, follow these steps:
groupadd sonar useradd -c "Sonar System User" -d /opt/sonarqube -g
sonar -s /bin/bash sonar chown -R sonar:sonar /opt/sonarqube
Then edit the file present here:
/opt/sonarqube/bin/sonar.sh
Find the line which reads RUN_AS_USER=sonar which will be commented, and then change as sonar and try to run the app now.

AIX agent failing after Bamboo upgrade 5.5->5.7

We always have hard time with Bamboo upgrades because AIX agents are not officially supported. No exception this one, from 5.5.1 to 5.7.2 (sad) It is trying to receive/start a job and apparently is failing to read some serialized XML. Last time moving to 5.5.1 we had to use previous version of JNA (3.4.0) instead one packaged with Bamboo (4.1.0). It did not happen this time so we use the latest one that comes with Bamboo 5.7. Agent comes on-line but fails to execute even simple commands (sad) Any ideas would be appreciated!
The java version on AIX currently is:
java version "1.7.0"
Java(TM) SE Runtime Environment (build pap6470sr6fp1-20140108_01(SR6 FP1))
IBM J9 VM (build 2.6, JRE 1.7.0 AIX ppc64-64 Compressed References 20140106_181350 (JIT enabled, AOT enabled)
J9VM - R26_Java726_SR6_20140106_1601_B181350
JIT - r11.b05_20131003_47443.02
GC - R26_Java726_SR6_20140106_1601_B181350_CMPRSS
J9CL - 20140106_181350)
JCL - 20140103_01 based on Oracle 7u51-b11
And here is part of the log showing error when agent is trying to execute the very first job:
2015-01-08 12:11:38,417 INFO [Thread-5] [AgentHeartBeatJobScheduler] Scheduled AgentHeartBeatJobScheduler to run every 60s. Next run at Thu Jan 08 12:11:38 PST 2015
2015-01-08 12:11:38,455 INFO [Thread-5] [RemoteAgent] **************************************************************************************************************************************************
2015-01-08 12:11:38,455 INFO [Thread-5] [RemoteAgent] * *
2015-01-08 12:11:38,455 INFO [Thread-5] [RemoteAgent] * Bamboo agent 'ibmaix71vm2.woods.ad' ready to receive builds.
2015-01-08 12:11:38,455 INFO [Thread-5] [RemoteAgent] * Remote Agent Home: /bamboo/bamboo-agent-home
2015-01-08 12:11:38,456 INFO [Thread-5] [RemoteAgent] * Broker URL: failover:(tcp://192.168.223.200:54663?wireFormat.maxInactivityDuration=300000)?initialReconnectDelay=15000&maxReconnectAttempts=10
2015-01-08 12:11:38,456 INFO [Thread-5] [RemoteAgent] * *
2015-01-08 12:11:38,456 INFO [Thread-5] [RemoteAgent] **************************************************************************************************************************************************
2015-01-08 12:11:38,511 INFO [scheduler_Worker-1] [AgentHeartBeatJob] executableBuildAgent still unavailable. Heartbeat skipped.
2015-01-08 12:16:38,425 INFO [0-BAM::ibmaix71vm2.woods.ad::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Agent 747175938 checking build queue for executables...
2015-01-08 12:16:38,825 ERROR [0-BAM::ibmaix71vm2.woods.ad::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Unknown exception occurred on 'ibmaix71vm2.woods.ad'. Agent will attempt to recover its normal operation...
com.thoughtworks.xstream.converters.ConversionException: java.lang.ref.ReferenceQueue$Null : java.lang.ref.ReferenceQueue$Null
---- Debugging information ----
message : java.lang.ref.ReferenceQueue$Null
cause-exception : com.thoughtworks.xstream.mapper.CannotResolveClassException
cause-message : java.lang.ref.ReferenceQueue$Null
class : com.atlassian.util.concurrent.ResettableLazyReference$InternalReference
required-type : com.atlassian.util.concurrent.ResettableLazyReference$InternalReference
converter-type : com.thoughtworks.xstream.converters.reflection.ReflectionConverter
path : /result/value/parentBuildContext/variableContext/effectiveStateRef/referrent/queue
line number : 234
class[1] : com.atlassian.bamboo.variable.VariableContextImpl$1
class[2] : com.atlassian.bamboo.variable.VariableContextImpl
class[3] : com.atlassian.bamboo.v2.build.BuildContextImpl
converter-type[1] : com.atlassian.bamboo.serialization.xstream.BuildContextXStreamConverter
class[4] : org.springframework.remoting.support.RemoteInvocationResult
version : not available
-------------------------------
at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:79)
at com.thoughtworks.xstream.core.AbstractReferenceUnmarshaller.convert(AbstractReferenceUnmarshaller.java:65)
at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at com.thoughtworks.xstream.core.AbstractReferenceUnmarshaller.convert(AbstractReferenceUnmarshaller.java:65)
Someone at Atlassian suggested to try OpenJDK and it solved our problem. We didn't have time to try different JVM builds as per #technomage, but found this link for downloads.

How to run nutch 1.9 in eclipse on windows?

I want to run Nutch 1.9 in Eclipse on Windows. I followed the tutorial from http://wiki.apache.org/nutch/RunNutchInEclipse and opened the project in Eclipse.
But when I run Nutch, I get the following error:
2014-09-19 17:45:48,039 INFO crawl.Injector (Injector.java:inject(283)) - Injector: starting at 2014-09-19 17:45:48
2014-09-19 17:45:48,043 INFO crawl.Injector (Injector.java:inject(284)) - Injector: crawlDb: K:/kumar/Nutch/apache-nutch-1.9/crawlresult
2014-09-19 17:45:48,043 INFO crawl.Injector (Injector.java:inject(285)) - Injector: urlDir: K:/kumar/Nutch/apache-nutch-1.9/urls
2014-09-19 17:45:48,043 INFO crawl.Injector (Injector.java:inject(294)) - Injector: Converting injected urls to crawl db entries.
2014-09-19 17:45:48,207 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-09-19 17:45:48,252 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(661)) - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
2014-09-19 17:45:48,268 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1
2014-09-19 17:45:48,485 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1275)) - Running job: job_local_0001
2014-09-19 17:45:48,487 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1
2014-09-19 17:45:48,526 INFO mapred.MapTask (MapTask.java:runOldMapper(347)) - numReduceTasks: 0
2014-09-19 17:45:48,565 INFO plugin.PluginRepository (PluginManifestParser.java:parsePluginFolder(87)) - Plugins: looking in: K:\Nutch\apache-nutch-1.9\plugins
2014-09-19 17:45:48,566 WARN plugin.PluginRepository (PluginManifestParser.java:parsePluginFolder(101)) - java.io.FileNotFoundException: K:\Nutch\apache-nutch-1.9\plugins\creativecommons\plugin.xml (The system cannot find the file specified)
It seems that Hadoop is the causing error. I don't know how to solve this problem. I know Nutch requires Unix environment. But, I want to run Nutch in Eclipse on Windows.
Can anybody help me to solve this?
Download cygwin, then add that to your path of the environment variables. I think your problem is caused by the fact that windows can't invoke a unix native command. That is what I did however as soon as i got past that problem, I encountered other problems.

Categories