I was developing a social media aggregator and was wondering if there was a way to crawl FaceBook, Twitter and other social media networking sites, by using Java Code. I want to crawl specific data from FaceBook Pages. Do I require specific permissions from FaceBook or any other requirement?
Technically yes... #2
https://www.facebook.com/legal/terms
If you're building it in Java as a Robot, I've had more success using JS and a local/remote webserver. Though this in theory is more easily detected
If you're building it as an essentially automated web browser as long as you rate limit yourself and add in a little random wait there is no good way of detecting it.
Yes according to https://www.facebook.com/apps/site_scraping_tos_terms.php you need written permission from Facebook if you are going to crawl them.
Related
I'm a newbie android developer and we have a website that sells some stuff (using a payment gateway), you can also login on the site using credentials, facebook, or google+ login. Now we have a need for an android and iOS app. What is the best approach to port the site functionalities to Android or iOS app? What are the issues I need to consider when I choose one approach? What would be the best approach: native, hybrid (phonegap, xamarine etc.) or using wrapped (using webview as far as I know)? I'm especially interested in the user login part (because I want the user to be able to login to his account if it exists and if not to create it using the website API endpoint - this is how I imagine it), how to solve that when choosing between these approaches? Any suggestions (answers, comments, links, books) would be helpful.
Thanks
My sugestion is to do native, always can reach more performance in multi thread ,high concurrency transactions and heavy applications.
For android, you can build from source an application, and export the html/css content to the smartphone using android.webkit.WebView. Take a look:
https://developer.android.com/reference/android/webkit/WebView.html
I think is a excellent solution for your problem.
I am writing a cross platform app(PC, iOS, Android) in Java. I would like to integrate facebook into this app. I have been trying to find a uniform method to login, since it is a cross-platform applicaiton. So I have been following Facebook's manual login to try an approach that will work on each platform. I am using restFB to handle the interaction with Facebook after I get the access token from the user. That last bit is causing difficulties. It seems the only way for me to get the users access token is to have them sign in from an embedded browser.
Now I have looked at this similar question, but the problem is that Libgdx is not compatible with JavaFX. So my question is: Is there a relatively simple way to embed a web browser into an app that is built via Libgdx?
So my question is: Is there a relatively simple way to embed a web browser into an app that is built via Libgdx?
Nop
I am working on a requirement in which I have to create new registration module for creating a new account on google. I plan to used google app engine with Java environment.
Now I have no idea for meet this requirement.
Can you advise me to create this module.
And I have another one question, does Google APP (Free Edition) use SSO or not?
To my understanding Gae does use sine sign on
I would suggest you to take a look at documentation on GAE here
And a small article written for authentication by me here
When user is redirected to Google login screen, and he does not have an ID, he can create one ( I would first suggest you to work on part where user is forwarded to login screen and is asked to login, you will understand what I mean)
As far SSO, there are discussions here and here which do suggest it can work with proper configuration. Hope this helps
We are in the process of looking at allowing mobile devices to view our site. We have targeted 3 phones - BlackBerry, iPhone and Android.
Being new to all this I have several questions.
I am going to assume that what we are really looking at here is the browser capabilities of the devices and not so much the device itself (the device comes into play if we are building a mobile application - correct?)
So, We have an on line auction site in which the front end is build using JSF 1.1, myFaces and RichFaces. We are going to move to JSF 1.2 anyway and this will allow us to make use of Trinidad since it appears to be friendly to a mobile site.
The concern I have is performance. On our current site we allow the user to do a search and the result of that search can be a lot of data returned. Running from a desktop browser there is a wait for result set now. I can only assume that there will be a greater wait for the result set when viewing from a mobile device unless we do something different for these request - is that correct?
So just building a mobile front end is still not going to address any performance issues that we face with the non mobile site - is that correct statement?
Are there any sites out there that are recommended to learn more about how to take a site and make it mobile ready?
Thanks
You could start from http://www.w3.org/TR/mobile-bp/ if you are a web designer/developer you already know everything to design for mobile devices. you just need some info about browser capabilities of your target devices and for that you can have a look at http://tech.groups.yahoo.com/group/wmlprogramming . For basics of web development for iPhone (also for Android ) http://building-iphone-apps.labs.oreilly.com/ch01.html is a good start
I have read the Blackberry documentation and it is possible to push a notification from a webapp. I am planning to create a Blackberry application that compliments to our webapps. But I am still left in the middle whether to develop a webapp or native Blackberry app. I have also look at how a webapp runs on Blackberry browser and it looks smooth.
From your experience does the native app offer something that the webapp doesn't? Bonus question, is Facebook and Twitter app on Blackberry a native app or a webapp? If it is a webapp, is it possible to make a launcher for the application on Blackberry?
Thanks for your help.
Facebook and Twitter are on both types. The web apps are just a website formatted for a small screen so anything you do in say asp.net will show on a blackberry web app if you program it to. The native app just feels like part of my phone. You can save data on the phone so if your app is a relating to news or something that would be stored I can read it offline or slow connectivity (camping, rural areas, etc...). It can also interact with other feature that blackberry offers such as contacts, email, media player, etc...
If you would like to save anything for the user to view without pinging the internet a native app would be preferred.
It's possible to create a launcher but I haven't created one so I'm not sure of the details. I would assume it's just an app that opens the browser to your URL.
One more thing about a web app would be if your application stores users settings (twitter auth key, etc...) they would need to be stored on your server and not the users phone adding more expense and maintenance.
Good Luck.
Widget is not supported for device software less than 5 , you combine both of web and native development by using browser field ,but you need to consider that its Java Script support is poor
Let's not forget that the blackberry browser is really bad as well. I don't know any BB users who would want to use a web application because of that.
When it comes to native apps, you have some choice however and you are not restricted to java (depending on which OS version you want to target). In addition to the mentioned Java, you can use Widget (link for resources) that behaves like a native app, but can be accessed like a web app.
I was just at innoTech and they had a whole session on this topic. But instead of recaping it let me just post the funny video they showed at the end which sums it all up.
Mobile Dev Rap Battle: Native Code vs. Web Apps