Relative paths in Python

In the file that has the script, you want to do something like this: This will give you the absolute path to the file you’re looking for. Note that if you’re using setuptools, you should probably use its package resources API instead. UPDATE: I’m responding to a comment here so I can paste a code sample. 🙂 … Read more

Running Bash commands in Python

On my local machine, I run a python script which contains this line This works fine. Then I run the same code on a server and I get the following error message So what I did then is I inserted a print bashCommand which prints me than the command in the terminal before it runs it with os.system(). … Read more

Errno 13 Permission denied Python

Your user don’t have the right permissions to read the file, since you used open() without specifying a mode. Since you’re using Windows, you should read a little more about File and Folder Permissions. Also, if you want to play with your file permissions, you should right-click it, choose Properties and select Security tab. Or if you want to be a little more hardcore, you can … Read more

ValueError: unsupported pickle protocol: 3, python2 pickle can not load the file dumped by python 3 pickle?

You should write the pickled data with a lower protocol number in Python 3. Python 3 introduced a new protocol with the number 3 (and uses it as default), so switch back to a value of 2 which can be read by Python 2. Check the protocolparameter in pickle.dump. Your resulting code will look like this. There is no protocolparameter in pickle.load because pickle can determine … Read more

How to change dataframe column names in pyspark?

There are many ways to do that: Option 1. Using selectExpr. data = sqlContext.createDataFrame([(“Alberto”, 2), (“Dakota”, 2)], [“Name”, “askdaosdka”]) data.show() data.printSchema() # Output #+——-+———-+ #| Name|askdaosdka| #+——-+———-+ #|Alberto| 2| #| Dakota| 2| #+——-+———-+ #root # |– Name: string (nullable = true) # |– askdaosdka: long (nullable = true) df = data.selectExpr(“Name as name”, “askdaosdka as age”) … Read more

SyntaxError invalid token

In Python 3, leading zeros are not allowed on numbers. E.g: Etc. are not allowed, but should be written as 5 and 123 instead. In Python 2, however, the leading zero signifies that the number is an octal number (base eight), so 04 or 03 would mean 4 and 3 in octal, respectively, but 08 would be invalid as it is not a valid octal number. In Python 3, the syntax … Read more

How to append multiple values to a list in Python

You can use the sequence method list.extend to extend the list by multiple values from any kind of iterable, being it another list or any other thing that provides a sequence of values. So you can use list.append() to append a single value, and list.extend() to append multiple values.