Encoding of characters when running powershell script as python subprocess

Question

Currently, I'm scripting a small python application that executes a PowerShell script. My python script should process the returned string but unfortunately, I have some trouble with the encoding of special characters like 'ä', 'ö', 'Ü' and so on. How can I return a Unicode/UTF-8 string?

You can see a simple example below. The console output is b'\xc7\xcf\r\n'. I don't understand why it's not b'\xc3\xa4\r\n' because \xc3\xa4 should be the correct UTF8 Encoding for the character 'ä'.

try.py:

import subprocess
p = subprocess.check_output(["powershell.exe", ".\script.ps1"])
print(p)

script.ps1:

return 'ä'

I adopted my PowerShell script in some ways but did not get the desired result.

Added "[Console]::OutputEncoding = [Text.UTF8Encoding]::UTF8". Result: b'\xc3\x83\xc2\xa4\r\n'
Returned return [System.Text.Encoding]::UTF8.GetBytes("ä"). Result: b'195\r\n131\r\n194\r\n164\r\n'

Who can help to get console output of 'ä' for my upper script?

Possibly related stackoverflow.com/a/49630797/5320906

snakecharmerb
– snakecharmerb

2019-06-29 10:12:21 +00:00
Commented Jun 29, 2019 at 10:12 — snakecharmerb
– snakecharmerb, Commented Jun 29, 2019 at 10:12

Nitin · Accepted Answer · 2019-06-27 09:54:10Z

1

I used "pwsh" because I ran it on mac, you can use "powershell.exe" in your code Try this:

import subprocess

p = subprocess.check_output(["pwsh", ".\sc.ps1"])
print(p.decode('utf-8'))

For more: You can read here.

Working Screenshot

answered Jun 27, 2019 at 9:54

Nitin

2441 silver badge7 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

PSaR Over a year ago

I have installed pwsh and tested it with both and added print(p.decode('utf-8')) to my try.py script. I get from pwsh the string b'\x84\r\n' and from powershell b'\xc7\xcf\r\n'. Result for pwsh is:

Traceback (most recent call last): b'\x84\r\n'   print(p.decode('utf-8')) UnicodeDecodeError: 'utf-8' codec can't decode byte 0x84 in position 0: invalid start byte

Collectives™ on Stack Overflow

Encoding of characters when running powershell script as python subprocess

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related