Java - working with different cmd charsets - java

I want to read a file path from the user in java console application,
some of the file path may contain some Hebrew characters.
how can i read the input from the command line when i don't know the encoding charset?
I have been spending some time on the web and didn't succeed to find any relevant solution that will be dynamic for every platform.
*
Screen shot when running in console

If you are using windows you need to check the terminal encoding before to make sure that its encoding supports hebrew.
To do this just type chcp in the console
as output you should see chcp 28598
if you see diffrent number type chcp 28598
Now your console encoding is set to hebrew and you should be able to write the path in hebrew without getting any exception.

Related

VSCode Java UTF-8 does not print characters to the console

I have a problem with encoding Java System Output occurring only in Visual Studio Code.
Like you can see in the image below bullet print as ?
Eclipse and IntelliJ print the bullet point just fine.
My program is very simple:
Things I have tried/checked:
chcp:
UTF8 is set:
I only have the Java Extension Pack by Microsoft installed.
It is a fresh new file created from VScode.
The chcp inside VSCode terminal is Active code page: 65001
The UTF-8 displayed in the lower right corner of VS code is the encoding format of the current file, not the encoding format of the terminal.
You should check the encoding by typing chcp in the terminal of VS code.
The encoding format of the terminal in vscode may be different from the system's cmd and powershell encoding.
So please check the encoding format in the terminal in VS code, not in the cmd or powershell window of the system
Here is my test display:
my code:
public class App {
public static void main(String[] args) {
System.out.println("example ●");
}
}
The encoding format of the system cmd window is 65001
The encoding format of the system powershell window is 65001
But the terminal encoding in vscode is 437
Run the result directly ( Can't display symbols )
So you need to use chcp 65001 to change the current terminal encoding format in VS code.
then run the code ( success display symbol)
But this still has problems, every time you open a new terminal, you need to manually type the command chcp 65001 to change the encoding format.
I found a way in my constant search. Add the following configuration in settings.json:
"terminal.integrated.shellArgs.windows": ["-noexit", "chcp 65001"]
A yellow squiggly line will appear indicating that this configuration is out of date and there are now new configuration commands. Never mind, this still works. If you want to see the new configuration, here.
Note: After adding this configuration, you need to restart VS code to take effect.
In this way, when you create a new terminal, you will automatically use the command chcp 65001 to change the encoding to 65001
Now run the code directly, the symbols can be displayed

Trying to print "white smiling face" using UTF-16 character code \u263A

I am trying to print the "white smiling face" to the console window using the following line of code in Java:
System.out.println( '\u263A' );
I do not get Smiley but some other character that looks a little like a question mark.
I am running the Windows 7 Pro operating system using jdk and jre versions 1.8.0_66 Any hints as to why?
Note: I am using the Consolas font in the console window which maps the code to the ideograph according to the character map dialogue.
This is not really a problem in your code. As commenters have pointed out, there is a difference between writing a Unicode code point and how your applications or OS choose to render a sequence of bytes as a character. Here is what I get on Mac:
> javac TestWhiteSmilingFace.java && java TestWhiteSmilingFace
☺
The Windows console does not support Unicode output though. Instead, it operates on Windows Code Pages.
If you are willing to pipe output to a separate file and then open it in Notepad, then here is an approach that has worked successfully for me.
Start cmd.exe with the /U option. As discussed in cmd documentation, This option forces command output redirected to a file to be in Unicode.
Redirect the command output to a file, i.e. java TestWhiteSmilingFace > TestWhiteSmilingFace.txt.
Open the file in Notepad, i.e. notepad TestWhiteSmilingFace.txt.
This prior answer discusses the Windows console Unicode limitation in more detail and also suggests using the PowerShell Integrated Scripting Environment as a potential workaround.
Printing Unicode characters to the PowerShell prompt

Cannot read special characters from the filename

I have a situation where linux mounted NAS includes filenames which has Scandinavian characters like ä, ö, å. When I list files with ls I see all those characters as question marks (?). If I run ls -b I will see encoded version of filename. Characters like this: \303\205
I need to read those files and their filenames from my Java code but I'm not able to. If I use File.listFiles to list files I'm getting question marks instead of correct characters. If I convert File to Path I'm getting exception:
java.nio.file.InvalidPathException: Malformed input or input contains unmappable characters
I' able to get rid of the exception, if I set Dsun.jnu.encoding=UTF-8 when running it, but then again I get question marks instead of ä,ö or å.
I tried to mount NAS different with settings like check=relaxed but not luck there.
All help is appreciated.
Ok, solved this one. If I login from the Linux to the server, which I use to run the code, it DOES NOT set LC_CTYPE, BUT if I login with my MAC it DOES set it UTF-8. So how application works on the server is dependent on the SSH client I use to run it....

java argument with greek characters in windows

I have created a simple .jar file which is taking as argument a string with greek characters and prints it in a file.
However, I have the following issue:
When I execute the jar file from my local windows machine, the string is properly passed as argument in the jar file and the output in the file contains the greek characters I inserted.
When I try to execute the same jar file in a windows VM, the greek characters are not properly encoded and the output in the file contains unreadable characters.
I have even set the command prompt in the VM in chcp 1253 and set an environmental variable as JAVA_TOOL_OPTIONS=-Dfile.encoding=UTF-8 with no luck...
Any suggestion?
Running chcp 1253 sets your console codepage to Windows 1253, and yet you set Java to not use it...
If you are running your program via a batch script, save it as UTF-8 and add -Dfile.encoding=UTF-8 to parameters for the java command.
If you are running your program via the console, run chcp 65001 to switch the console to UTF-8. Also, you set the variable correctly, you can leave it that way, but you can also run Java with this option set explicitly:
chcp 65001
java -Dfile.encoding=UTF-8 -jar binks.jar
EDIT: If Windows is still complaining and/or messing stuff up, try changing 65001 to 1523 and UTF-8 to Windows-1253. You'll lose support for most of Unicode, but there's greater chance now it will work.

Junk character output even after encoding

So, I have basically been trying to use Spanish Characters in my program, but wherever I used them, Java would print out '?'.
I am using Slackware, and executing my code there.
I updated lang.sh, and added: export JAVA_TOOL_OPTIONS=-Dfile.encoding=UTF-8
After this when I tried printing, it did not print the question marks, but other junk characters. I printed the default Charset on screen, and it has been successfully set, but it is not printing properly.
Help?
Thanks!
EDIT: I'm writing code in windows on NetBeans, and executing .class or .jar on slackware.
Further, I cannot seem to execute locale command. I get error "bash: locale: command not found".
This is what confuses me: When I echo any special characters on Slackware console, they are displayed perfectly, but when I run a java program that simply prints it's command line arguments (and I enter the special characters as Command Line input), it outputs garbage.
If you are using an ssh client such as PuTTY, check that it is using a UTF-8 charset as well.

Categories