Architecture/Technology advice for pipeline using Hadoop/Hive [closed] - java

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 8 years ago.
Improve this question
My architecture is built of couple of stages.
1. ETL putting files on HDFS file system.
2. Hive running sql scripts on top of Hadoop and generating result set table.
3. The table is converted into XML
4. the XML is being uploaded to another location using http post.
We found our self having logic on Hive sql's and bash scripts. not sure if that's the right way of doing this.
I am looking for a pipleline framework to help me nail this architecture(Java/Spring or any other).
Any suggestions? examples? I tried PIG but we have complications with that.
Thanks,
ray.

Related

OrientDB schema migration tool for Java [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
Is there a tool for managing changes of OrientDB schemas?
I am familiar with Flyway, but it has no support for OrientDB, so it will be great if there is something similar you could recommend.
My requirements are below:
Written in Java
Can use native OrientDB API to execute queries (not only JDBC)
Can use Java based migrations (not only queries)
See this related feature request already added to the Flyway 5.2.0 milestone, but no ETA announced.
We're currently investigating contributing to this, as we'll need that exact feature.

Any library to read mdict *.MDX files in java? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 4 years ago.
Improve this question
I was looking for any library or sources which helps me to read MDX dictionary files in Java, I have found some resources already such as mdict-android-opensource but it does not have its implantations to how read mdx database files. Does any one knows a good source about these files and possible libraries which could be used for it?
Thanks very much.
As far as I know, mdx is not a 'database'. database can be something like a file system, while mdx is just a set of binary data stored on the disk. However they uses similar techniques: Index and Binary search.
mdict-android-opensource only opensourced it's UI side.
Here's my implementation to parse and query mdx files: mdict-java ,it's under the Apache license.
and you can also try my application on the play store.

What database i used for java offline application [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 7 years ago.
Improve this question
I want to develop application.which is offline(runs on single pc).Which database i should use so that when I create exe of my project it will automatically included in it.
It sounds like you're looking for an embedded database. Here is a thread on Java embedded databases. I use Apache Derby, mostly because it's easy to use with NetBeans.
You can look to the H2 database, no db server is needed!
http://www.h2database.com/html/main.html
You can use MS-Access. That works totally offline and you can include it in your project. It is also easy to work with MS-Access & Java.
Hope this helps.

Tool for generating control flow in Java [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
I need a tool for generating control flow in java, but not a visual draw, something that I can work with like with path conditions or so.
Anyone ?
To future record, what I´ve found that best suits to my needs is Soot.
http://www.sable.mcgill.ca/soot/
The ASM library can do that, at the JVM-bytecode level. See Method Analysis and Control flow analyses in http://download.forge.objectweb.org/asm/asm4-guide.pdf (page 121).
Atlas is an Eclipse plugin that enables program analysis. It has a querable graph database that includes the control flow graph (as well as data flow and other relationships).
Maybe this is what you were looking for http://www.jboss.org/jbpm

Looking for an open source visualization library that will allow dynamic changes to the graph/tree in Java? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 8 years ago.
Improve this question
I'm looking for a library that will allow me to construct a Tree and dynamically generate the branches/leaves of this tree at run time based on which branch the user selects.
Basically, it's similar to this prefuse example: http://prefuse.org/gallery/treeview/ except that the data isn't predifined in a an XML file. Rather the data is generated behind the scenes in my code based on the user's selection.
Is there such a library for this task?
Have a look at yFiles, JGraph, JGraphT or the alternatives on this list.

Categories