I have been investigating Gobblin for awhile and currently I am experiencing difficulties in using Gobblin to get post from Facebook. I could not find any connection example on the internet or I may have searched it wrongly.
I am looking at integrate restfb to Gobblin, however in Gobblin, there is a RestAPI class with connector, source and extractor and I am struggling to find a way to combine these together. Could you please help me with a simple guide on how to implement this or point me to the correct instruction? Thank you very much in advance.
I am working on the same thing, I have extracted my data using the graph-facebook api using a java code. I recently started using gobblin for extracting data. In the beginning i ran gobblin on the debug mode to get an idea as to how the flow was, I think you should definitely try doing that. Now I get my data as a json object and use convertors, Builders, Writers available to get data on to HDFS.
If you want some pointers as to how to run gobblin on debug mode you can comment below, I'll be happy to help.
Related
I am using the ElasticsearchService from Amazon. I am a little overwhelmed by their documentation. I find it vast but ever so difficult to navigate. Anyway, I am looking for an example of using the ESService using their AWS Java SDK. Do you have a link - or some code to insert a document?
I am actually using it from Scala, and what I've got so far is:
val awsEsClient: AWSElasticsearchClient = new AWSElasticsearchClient()
awsEsClient.setRegion(Region.getRegion(Regions.EU_CENTRAL_1))
awsEsClient.setEndpoint("es.eu-central-1.amazon.aws.com")
val createD = new CreateElasticsearchDomainRequest()
Where should I specify my own instance ARN? The uri that looks like
arn:aws:es:eu-central-1:xxxxxxxxxxx:domain/yyyyyyyy
Also, when using their SDK, I guess I don't need to specify anywhere the endpoint they provide? The one that goes by
search-yyyyyy-xxxxxxxxxx.eu-central-1.es.amazonaws.com
Or maybe this is what I should specify instead of the
awsEsClient.setEndpoint("es.eu-central-1.amazon.aws.com")
Thank you for your help and sorry if all these questions sound obvious.
So, I got the whole thing wrong from the beginning. The SDK is useful only in order to manage the service, like spin up new nodes and similar -- not to access it. For that, the only solution that Amazon offers is an HTTP endpoint, using the common REST api offered by Elastic Search.
The problem that came next was to authenticate the requests. I have compiled a scala library to do that for every request, which is available here: https://github.com/ticofab/aws-request-signer.
I want to load nodes from the neo4j to java code.
I tried all the way from google but it doesn't work. Can you help me by specific code?
There is a lot of information in the Neo4j manual and on the developer pages.
Please read there, and come back to ask if you have still questions:
http://neo4j.com/developer/java
http://neo4j.com/docs/stable/tutorials-java-embedded.html
http://neo4j.com/docs/stable/server-java-rest-client-example.html#_sending_cypher
We made our own api for airbrake.io in java. This works fine but airbrake is displaying parameters and stacktraces in some kind of Rails style. This is somewhat annoying. Anyone know of similar services made for java?
Example of how data is displayed:
Parameters
{"controller"=>"", "action"=>""}
Stacktrace
/testapp/app/models/user.rb:53:in `public'
/testapp/app/controllers/users_controller.rb:14:in `index'
UPDATE 2015-02-13: This service no longer exists. The GitHub account linked below is gone, as is the company website.
Have you tried using Coalmine https://github.com/coalmine/coalmine_java Its meant to be used with the Coalmine service: https://getcoalmine.com/
I work at Coalmine and we have been using this internally for some time now. We just open sourced the java connector this week and I would be happy to help you get started with it. You can send me an email at brad#builtfromsource.com
Have you tried using http://code.google.com/p/hoptoad/ . It's a little out of date, but it should just need to update an endpoint to http://api.airbrake.io .
A quick google lead me to http://logdigger.com/ which is designed specific for JAVA specific sites.
I work at Airbrake, and I would be happy to work with you to make our site more JAVA friendly. Please get in touch ben#airbrake.io, and I'll see how we can better display java specific information.
Just adding to the others suggested here, but Raygun (http://raygun.io) has first class support for Java.
Read more here: http://raygun.io/java
I work for Mindscape who built Raygun so can answer any questions you may have about it: jd#mindscape.co.nz. We already have a large number of organizations using Raygun with their Java apps, although Raygun does support other platforms (.NET, Node, Rails, PHP, etc)
I am a newbie in this site but I know anyone here can help me on this problem that I have now. I used to program Java using JDK7 and now I am facing this JTOpen API for AS400-Java interface but my problem now is how to get all the PSF Setting of my Device Description of a certain Writer?
Thanks in advance guys....
Please help.....
Check out the print API's at http://publib.boulder.ibm.com/infocenter/iseries/v5r4/topic/apis/print1a.htm
If you can find an API that provides the information you are looking for, it shouldn't be hard to invoke it from java.
Some of that information is available in com.ibm.as400.access.PrintObject but not all. I'd write a wrapper program/procedure over the Retrieve AFP Information (QPQRAFPI) API, and use JT400 to call that. The equivalent CL command is WRKPSFCFG.
Can someone provide me a working example which gets reports from jasperserver using it's SOAP API.
Actually I know how to run it to a file.... but I need to get report data directly.
Thanks in advance!
I've tried a lot of ways of doing the above thing, and what I've came up with is to get report from JasperServer in JasperPrint format and then export it in whatever you need. Another way of solving that problem is to get report via HTTP API.
You can check out http://www.codeproject.com/KB/ajax/JavaScriptSOAPClient.aspx
But I had the same issue of having to go to jasperserver direct. If you're doing this on a PHP server they have quite a bit of PHP demo code that does the SOAP call for you. I used that and found it far easier to implement than doing it with JavaScript. The above link though should help you with making the SOAP call.
I found Jaspers SOAP documentation lacking so having the PHP source code that did a working example was quite helpful.