Is there any parsing when reading 'clean' text file using Scanner? - java

I know that:
Parsing is the process of turning some kind of data into another kind
of data.
But then I also came across this difference between Scanner and BufferedReader:
BufferedReader is faster than Scanner because BufferedReader does not
need to parse the data.
So my question is how is using Scanner slower than using BufferedReader if I am reading just text file (plain characters) and I am not doing any parsing? Is there any parsing I am not aware of?
Or from following code perspective, how is here Scanner slower because of parsing than using BufferedReader?
//1
BufferedReader bufferedReader = new BufferedReader(new FileReader("xanadu.txt"));
System.out.println(bufferedReader.readLine());
//2
Scanner scanner = new Scanner(new FileReader("xanadu.txt"));
scanner.useDelimiter("\n");
System.out.println(scanner.next());
I don't understand quote how Scanner is slower because of parsing, when I am technically not parsing any data..

Dividing an input stream into lines is a (very limited) form of parsing, but as you say BufferedReader can also do that. The difference, if there is one, will be that BufferedReader can use a highly-optimised procedure to implement a single use case (divide a stream into lines) while Scanner needs to be able to be considerably more flexible (divide a stream into tokens delimited by an arbitrary string or regular expression). Flexibility almost always comes at a price, although you won't know what that cost is without doing some benchmarking. (And it may be very small, since it is conceivable that Scanner has optimised algorithms for particular special cases which it can recognise.)
In short, "because parsing" is not a very good explanation for why one interface is slower than another one. But the more flexibly and precisely you parse an input, the more time it is expected to take.

Related

Why i always need to chain FileReader to other readers?

Why i always need to chain FileReader to other readers like BufferedReader or Scanner ?
Why i can't use just a FileScanner since it is Convenience for reading character files.
I'm just practicing and i do not care about the performance or functionality. Yet there is one method public int read() for FileReader and it return int, how can i use that integer number for chars?
BufferedReader is mainly used because it is more efficient than a FileReader. The difference between the two is that a FileReader is used to read characters from a file whereas BufferedReader wraps around FileReader and uses it to buffer the input (hence the name BufferedReader). This leads to passing FileReader to BufferedReader ending up with a more efficient way of reading.
But as you asked in the question... It is perfectly fine using FileReader as long as you are okay dealing with what it provides as functionality.

Difference between using java.io.* and java.util.Scanner [duplicate]

As far I know, the two most common methods of reading character-based data from a file in Java is using Scanner or BufferedReader. I also know that the BufferedReader reads files efficiently by using a buffer to avoid physical disk operations.
My questions are:
Does Scanner perform as well as BufferedReader?
Why would you choose Scanner over BufferedReader or vice versa?
Scanner is used for parsing tokens from the contents of the stream while BufferedReader just reads the stream and does not do any special parsing.
In fact you can pass a BufferedReader to a scanner as the source of characters to parse.
In currently latest JDK 18 release/build (b37), the Scanner has a smaller buffer (1024 chars) as opposed to the BufferedReader (8192 chars), but it's more than sufficient.
As to the choice, use the Scanner if you want to parse the file, use the BufferedReader if you want to read the file line by line. Also see the introductory text of their aforelinked API documentations.
Parsing = interpreting the given input as tokens (parts). It's able to give back you specific parts directly as int, string, decimal, etc. See also all those nextXxx() methods in Scanner class.
Reading = dumb streaming. It keeps giving back you all characters, which you in turn have to manually inspect if you'd like to match or compose something useful. But if you don't need to do that anyway, then reading is sufficient.
See this link, following is quoted from there:
A BufferedReader is a simple class meant to efficiently read from the
underling stream. Generally, each read request made of a Reader like a
FileReader causes a corresponding read request to be made to
underlying stream. Each invocation of read() or readLine() could
cause bytes to be read from the file, converted into characters, and
then returned, which can be very inefficient. Efficiency is improved
appreciably if a Reader is warped in a BufferedReader.
BufferedReader is synchronized, so read operations on a BufferedReader
can safely be done from multiple threads.
A scanner on the other hand has a lot more cheese built into it; it
can do all that a BufferedReader can do and at the same level of
efficiency as well. However, in addition a Scanner can parse the
underlying stream for primitive types and strings using regular
expressions. It can also tokenize the underlying stream with the
delimiter of your choice. It can also do forward scanning of the
underlying stream disregarding the delimiter!
A scanner however is not thread safe, it has to be externally
synchronized.
The choice of using a BufferedReader or a Scanner depends on the code
you are writing, if you are writing a simple log reader Buffered
reader is adequate. However if you are writing an XML parser Scanner
is the more natural choice.
Even while reading the input, if want to accept user input line by
line and say just add it to a file, a BufferedReader is good enough.
On the other hand if you want to accept user input as a command with
multiple options, and then intend to perform different operations
based on the command and options specified, a Scanner will suit
better.
BufferedReader has significantly larger buffer memory than Scanner. Use BufferedReader if you want to get long strings from a stream, and use Scanner if you want to parse specific type of token from a stream.
Scanner can use tokenize using custom delimiter and parse the stream into primitive types of data, while BufferedReader can only read and store String.
BufferedReader is synchronous while Scanner is not. Use BufferedReader if you're working with multiple threads.
Scanner hides IOException while BufferedReader throws it immediately.
I suggest to use BufferedReader for reading text. Scanner hides IOException while BufferedReader throws it immediately.
The difference between BufferedReader and Scanner are following:
BufferedReader is synchronized but Scanner is not synchronized.
BufferedReader is thread-safe but Scanner is not thread-safe.
BufferedReader has larger buffer memory but Scanner has smaller buffer memory.
BufferedReader is faster but Scanner is slower in execution.
Code to read a line from the console:
BufferedReader:
InputStreamReader isr = new InputStreamReader(System.in);
BufferedReader br = new BufferedReader(isr);
String st = br.readLine();
// You can make the object InputStreamReader object inside the BufferReader method.
BufferReader br = new BufferedReader(InputStreamReader(System.in));
String st = br.readLine();
// You can even inspect the type of the input stream manually by using Parse method which accepts string parameter.
int x = Integer.parseInt(br.readLine());
// Or you can pass the object directly.
int x = Integer.parseInt(st);
Scanner:
Scanner sc = new Scanner(System.in);
String st = sc.nextLine();
The differences between BufferedReader and Scanner are:
BufferedReader reads data, but Scanner parses data.
You can only read String using BufferedReader, using Scanner you can read to different data types like int.
BufferedReader is older than Scanner, it was added on JDK 1.1, while Scanner was added on JDK 5 release.
The buffer size of BufferedReader is larger (8KB) as compared to Scanner's 1KB.
BufferedReader is more suitable for reading files with long String, while Scanner is more suitable for reading small user input from command prompt.
BufferedReader is synchronized, while Scanner is not, which means you cannot share Scanner among multiple threads.
BufferedReader is faster than Scanner because it doesn't spend time on parsing.
BufferedReader is a bit faster as compared to Scanner.
BufferedReader is from java.io package, while Scanner is from java.util package.
On basis of the points we can select our choice.
Thanks for reading!
The Main Differences:
Scanner
Simple text scanner which can parse primitive types and strings using regular expressions.
Scanner breaks its input into tokens using a delimiter pattern, which by default matches whitespace. The resulting tokens may then be converted into values of different types using the various next methods.
Example:
String input = "1 fish 2 fish red fish blue fish";
Scanner s = new Scanner(input).useDelimiter("\\s*fish\\s*");
System.out.println(s.nextInt());
System.out.println(s.nextInt());
System.out.println(s.next());
System.out.println(s.next());
s.close();
prints the following output:
1
2
red
blue
The same output can be generated with this code, which uses a regular expression to parse all four tokens at once:
String input = "1 fish 2 fish red fish blue fish";
Scanner s = new Scanner(input);
s.findInLine("(\\d+) fish (\\d+) fish (\\w+) fish (\\w+)");
MatchResult result = s.match();
for (int i = 1; i <= result.groupCount(); i++) {
System.out.println(result.group(i));
}
s.close();
BufferedReader:
Reads text from a character-input stream, buffering characters so as to provide for the efficient reading of characters, arrays, and lines.
The buffer size may be specified, or the default size may be used. The default is large enough for most purposes.
In general, each read request made of a Reader causes a corresponding read request to be made of the underlying character or byte stream. It is therefore advisable to wrap a BufferedReader around any Reader whose read() operations may be costly, such as FileReaders and InputStreamReaders. For example,
BufferedReader in = new BufferedReader(new FileReader("foo.in"));
will buffer the input from the specified file. Without buffering, each invocation of read() or readLine() could cause bytes to be read from the file, converted into characters, and then returned, which can be very inefficient.
Programs that use DataInputStreams for textual input can be localized by replacing each DataInputStream with an appropriate BufferedReader.
Source used: https://docs.oracle.com
There are different ways of taking input in java like:
1) BufferedReader 2) Scanner 3) Command Line Arguments
BufferedReader Read text from a character-input stream, buffering characters so as to provide for the efficient reading of characters, arrays, and lines.
Where Scanner is a simple text scanner which can parse primitive types and strings using regular expressions.
if you are writing a simple log reader Buffered reader is adequate. if you are writing an XML parser Scanner is the more natural choice.
For more information please refer:
http://java.meritcampus.com/t/240/Bufferedreader?tc=mm69
The answer below is taken from Reading from Console: JAVA Scanner vs BufferedReader
When read an input from console, there are two options exists to achieve that. First using Scanner, another using BufferedReader. Both of them have different characteristics. It means differences how to use it.
Scanner treated given input as token. BufferedReader just read line by line given input as string. Scanner itself provides parsing capabilities just like nextInt(), nextFloat().
But, what is others differences between?
Scanner treated given input as token. BufferedReader as stream line/String.
Scanner tokenized given input using regex. Using BufferedReader must write extra code.
BufferedReader faster than Scanner *point no. 2
Scanner isn’t synchronized, BufferedReader synchronized
Scanner came with since JDK 1.5 and higher.
When should use Scanner, or Buffered Reader?
Look at the main differences between both of them, one using tokenized, others using stream line. When you need parsing capabilities, use Scanner instead. But, I am more comfortable with BufferedReader. When you need to read data from a File, use BufferedReader, because it uses buffer memory when it reads a file, and that reduces physical drive usage. Or you can use BufferedReader as input to Scanner.
I prefer Scanner because it doesn't throw checked exceptions and therefore it's usage results in a more streamlined code.
BufferedReader will probably give you better performance (because Scanner is based on InputStreamReader, look sources). oops, for reading data from files it uses nio. When I tested nio performance against BufferedReader performance for big files nio shows a bit better performance.
For reading data from a file try Apache Commons IO.

Performance measure of BufferedReader Vs BufferedInputStream

Recently I have modified my code to
While taking input form STDIN, I moved from Scanner to BufferedInputStream.
I also read about BufferedReader which takes the input from any InputStreamReader. This InputStreamReader can be used with System.in to take STDIN input.
BufferedInputStream has read() method, which further needs to be parsed according to the objective.
In my case first i need to take an integer (let say n) as input from STDIN after that a for loop will take n strings as input. These strings have at max 1,00,000 characters.
Question is : Which one among Scanner, BufferedInputStream and BufferedReader performs better for my objective?
Scanner was designed to simplify acceptance of input parameters at run time from user. This is the java equivalent of scanf()/getc()/cin. The 'Reader's are used to read character data, 'Stream's for streamed data. Scanner is best suited for your purpose. As it is simple to code and use.
I would use a BufferedReader in your case. It will be much faster than Scanner as your strings have quite a lot of characters.
BufferedReader br = new BufferedReader(new InputStreamReader(System.in));
//To get an integer
int N = Integer.parseInt(br.readLine());
//To get a string.
String line = br.readLine()

Use File or FileReader with Scanner?

Disclaimer: I've looked through all the questions I can find and none of them answers this exact question. If you find one please point me to it and be polite.
So, the Oracle I/O tutorial opens a text file with Scanner as follows:
new Scanner(BufferedReader(FileReader("xanadu.txt")));
But the Javadoc opens a text file with Scanner like this:
new Scanner(new File("myNumbers"));
It would be nice to use the simpler method, especially when I have a small file and can live with the smaller buffer, but I've also seen people say that when you open a File directly you can't close it. If that's the case, why is that idiom used in the official documentation?
Edit: I've also seen new Scanner(FileReader("blah.txt")); but this seems like the worst of both worlds.
Edit: I'm not trying to start a debate about whether to use Scanner or not. I have a question about how to use Scanner. Thank you.
You could look at implementation of Scanner (JDK is shipped with source code). There is a close() method in Scanner class as well. Essentially both approaches you listed are identical for your use case of reading small file - just don't forget to call close() at the end.
The File class has no close() method because it only abstracts a disk file. It is not an input stream to the file, so there is nothing to close.
Yes you can do that.
Basically you do:
Scanner file = new Scanner(new FileReader("file.txt"));
To read a String:
String s = file.next();
When you are done with the file, do
file.close();
Horses for courses. From the Scanner javadocs, a Scanner is "A simple text scanner which can parse primitive types and strings using regular expressions." So, my take on your question is: it does not matter which approach you use, the simpler option with File is just as good as the one found in Oracle tutorials. Scanner is for convenient tokenizing of text files, and if your file is small, as you said, than it's a perfect fit.
Because a Scanner uses regular expressions, you can't really expect huge performance with it, whether you create a buffered file reader for the scanner or not. The underlying Readable will be close()d (if it's a Closeable, which it will be, if you use the Scanner(File) constructor), and so you don't have to worry as long as you close() your Scanner object (or use try-with-resources).
There are multiple ways to construct a Scanner object.
http://docs.oracle.com/javase/1.5.0/docs/api/java/util/Scanner.html
I personally wouldn't even use Scanner for file reading though. Look at BufferedReader tutorials. It's not too hard to figure out.

Scanner vs. BufferedReader

As far I know, the two most common methods of reading character-based data from a file in Java is using Scanner or BufferedReader. I also know that the BufferedReader reads files efficiently by using a buffer to avoid physical disk operations.
My questions are:
Does Scanner perform as well as BufferedReader?
Why would you choose Scanner over BufferedReader or vice versa?
Scanner is used for parsing tokens from the contents of the stream while BufferedReader just reads the stream and does not do any special parsing.
In fact you can pass a BufferedReader to a scanner as the source of characters to parse.
In currently latest JDK 18 release/build (b37), the Scanner has a smaller buffer (1024 chars) as opposed to the BufferedReader (8192 chars), but it's more than sufficient.
As to the choice, use the Scanner if you want to parse the file, use the BufferedReader if you want to read the file line by line. Also see the introductory text of their aforelinked API documentations.
Parsing = interpreting the given input as tokens (parts). It's able to give back you specific parts directly as int, string, decimal, etc. See also all those nextXxx() methods in Scanner class.
Reading = dumb streaming. It keeps giving back you all characters, which you in turn have to manually inspect if you'd like to match or compose something useful. But if you don't need to do that anyway, then reading is sufficient.
See this link, following is quoted from there:
A BufferedReader is a simple class meant to efficiently read from the
underling stream. Generally, each read request made of a Reader like a
FileReader causes a corresponding read request to be made to
underlying stream. Each invocation of read() or readLine() could
cause bytes to be read from the file, converted into characters, and
then returned, which can be very inefficient. Efficiency is improved
appreciably if a Reader is warped in a BufferedReader.
BufferedReader is synchronized, so read operations on a BufferedReader
can safely be done from multiple threads.
A scanner on the other hand has a lot more cheese built into it; it
can do all that a BufferedReader can do and at the same level of
efficiency as well. However, in addition a Scanner can parse the
underlying stream for primitive types and strings using regular
expressions. It can also tokenize the underlying stream with the
delimiter of your choice. It can also do forward scanning of the
underlying stream disregarding the delimiter!
A scanner however is not thread safe, it has to be externally
synchronized.
The choice of using a BufferedReader or a Scanner depends on the code
you are writing, if you are writing a simple log reader Buffered
reader is adequate. However if you are writing an XML parser Scanner
is the more natural choice.
Even while reading the input, if want to accept user input line by
line and say just add it to a file, a BufferedReader is good enough.
On the other hand if you want to accept user input as a command with
multiple options, and then intend to perform different operations
based on the command and options specified, a Scanner will suit
better.
BufferedReader has significantly larger buffer memory than Scanner. Use BufferedReader if you want to get long strings from a stream, and use Scanner if you want to parse specific type of token from a stream.
Scanner can use tokenize using custom delimiter and parse the stream into primitive types of data, while BufferedReader can only read and store String.
BufferedReader is synchronous while Scanner is not. Use BufferedReader if you're working with multiple threads.
Scanner hides IOException while BufferedReader throws it immediately.
I suggest to use BufferedReader for reading text. Scanner hides IOException while BufferedReader throws it immediately.
The difference between BufferedReader and Scanner are following:
BufferedReader is synchronized but Scanner is not synchronized.
BufferedReader is thread-safe but Scanner is not thread-safe.
BufferedReader has larger buffer memory but Scanner has smaller buffer memory.
BufferedReader is faster but Scanner is slower in execution.
Code to read a line from the console:
BufferedReader:
InputStreamReader isr = new InputStreamReader(System.in);
BufferedReader br = new BufferedReader(isr);
String st = br.readLine();
// You can make the object InputStreamReader object inside the BufferReader method.
BufferReader br = new BufferedReader(InputStreamReader(System.in));
String st = br.readLine();
// You can even inspect the type of the input stream manually by using Parse method which accepts string parameter.
int x = Integer.parseInt(br.readLine());
// Or you can pass the object directly.
int x = Integer.parseInt(st);
Scanner:
Scanner sc = new Scanner(System.in);
String st = sc.nextLine();
The differences between BufferedReader and Scanner are:
BufferedReader reads data, but Scanner parses data.
You can only read String using BufferedReader, using Scanner you can read to different data types like int.
BufferedReader is older than Scanner, it was added on JDK 1.1, while Scanner was added on JDK 5 release.
The buffer size of BufferedReader is larger (8KB) as compared to Scanner's 1KB.
BufferedReader is more suitable for reading files with long String, while Scanner is more suitable for reading small user input from command prompt.
BufferedReader is synchronized, while Scanner is not, which means you cannot share Scanner among multiple threads.
BufferedReader is faster than Scanner because it doesn't spend time on parsing.
BufferedReader is a bit faster as compared to Scanner.
BufferedReader is from java.io package, while Scanner is from java.util package.
On basis of the points we can select our choice.
Thanks for reading!
The Main Differences:
Scanner
Simple text scanner which can parse primitive types and strings using regular expressions.
Scanner breaks its input into tokens using a delimiter pattern, which by default matches whitespace. The resulting tokens may then be converted into values of different types using the various next methods.
Example:
String input = "1 fish 2 fish red fish blue fish";
Scanner s = new Scanner(input).useDelimiter("\\s*fish\\s*");
System.out.println(s.nextInt());
System.out.println(s.nextInt());
System.out.println(s.next());
System.out.println(s.next());
s.close();
prints the following output:
1
2
red
blue
The same output can be generated with this code, which uses a regular expression to parse all four tokens at once:
String input = "1 fish 2 fish red fish blue fish";
Scanner s = new Scanner(input);
s.findInLine("(\\d+) fish (\\d+) fish (\\w+) fish (\\w+)");
MatchResult result = s.match();
for (int i = 1; i <= result.groupCount(); i++) {
System.out.println(result.group(i));
}
s.close();
BufferedReader:
Reads text from a character-input stream, buffering characters so as to provide for the efficient reading of characters, arrays, and lines.
The buffer size may be specified, or the default size may be used. The default is large enough for most purposes.
In general, each read request made of a Reader causes a corresponding read request to be made of the underlying character or byte stream. It is therefore advisable to wrap a BufferedReader around any Reader whose read() operations may be costly, such as FileReaders and InputStreamReaders. For example,
BufferedReader in = new BufferedReader(new FileReader("foo.in"));
will buffer the input from the specified file. Without buffering, each invocation of read() or readLine() could cause bytes to be read from the file, converted into characters, and then returned, which can be very inefficient.
Programs that use DataInputStreams for textual input can be localized by replacing each DataInputStream with an appropriate BufferedReader.
Source used: https://docs.oracle.com
There are different ways of taking input in java like:
1) BufferedReader 2) Scanner 3) Command Line Arguments
BufferedReader Read text from a character-input stream, buffering characters so as to provide for the efficient reading of characters, arrays, and lines.
Where Scanner is a simple text scanner which can parse primitive types and strings using regular expressions.
if you are writing a simple log reader Buffered reader is adequate. if you are writing an XML parser Scanner is the more natural choice.
For more information please refer:
http://java.meritcampus.com/t/240/Bufferedreader?tc=mm69
The answer below is taken from Reading from Console: JAVA Scanner vs BufferedReader
When read an input from console, there are two options exists to achieve that. First using Scanner, another using BufferedReader. Both of them have different characteristics. It means differences how to use it.
Scanner treated given input as token. BufferedReader just read line by line given input as string. Scanner itself provides parsing capabilities just like nextInt(), nextFloat().
But, what is others differences between?
Scanner treated given input as token. BufferedReader as stream line/String.
Scanner tokenized given input using regex. Using BufferedReader must write extra code.
BufferedReader faster than Scanner *point no. 2
Scanner isn’t synchronized, BufferedReader synchronized
Scanner came with since JDK 1.5 and higher.
When should use Scanner, or Buffered Reader?
Look at the main differences between both of them, one using tokenized, others using stream line. When you need parsing capabilities, use Scanner instead. But, I am more comfortable with BufferedReader. When you need to read data from a File, use BufferedReader, because it uses buffer memory when it reads a file, and that reduces physical drive usage. Or you can use BufferedReader as input to Scanner.
I prefer Scanner because it doesn't throw checked exceptions and therefore it's usage results in a more streamlined code.
BufferedReader will probably give you better performance (because Scanner is based on InputStreamReader, look sources). oops, for reading data from files it uses nio. When I tested nio performance against BufferedReader performance for big files nio shows a bit better performance.
For reading data from a file try Apache Commons IO.

Categories