Python Pandas: Replacement method for convert_objects()

The DataFrames.convert_objects() in Pandas is a very useful function to try to infer better data types for you imported data.

For example if you have just imported hockey player stats and the data looks like:
df.dtypes
Out[1]: 
PLAYER    object
TEAM      object
GP        object
G         object
A         object
PTS       object
+/-       object
dtype: object

Using convert_objects:
df.convert_objects(convert_numeric=True).dtypes
 __main__:1: FutureWarning: convert_objects is deprecated.  Use the data-type specific converters pd.to_datetime, pd.to_timedelta and pd.to_numeric.
Out[2]: 
PLAYER     object
TEAM       object
GP          int64
G           int64
A           int64
PTS         int64
+/-         int64
dtype: object


The return information indicates that it is deprecated, but isn't clear on a suitable replacement, because while convert_objects() tried to infer all columns in the data frame, pandas.to_numeric() is applied to a specific column. The solution is to combine it with the DataFrame.apply():

df.apply(pd.to_numeric, errors='ignore').dtypes
Out[3]: 
PLAYER     object
TEAM       object
GP          int64
G           int64
A           int64
PTS         int64
+/-         int64
dtype: object

Comments

  1. MattNovember 25, 2018 at 10:22 AM

    Thanks for your help. I found I needed:

    df = df.apply(pd.to_numeric, errors='ignore')

    ReplyDelete
  2. TaimoorApril 15, 2021 at 6:48 AM

    Great Help

    ReplyDelete

Post a Comment

Popular posts from this blog

How Salesforce uses AWS to Improve The Support Call Experience

Image
In April I wrote about how moving infrastructure to  the cloud is the start of a paradigm shift, and that building intelligence products and services is the next step. Today, I highlight an example of this presented by Salesforce and AWS . Youtube video link:  https://www.youtube.com/watch?v=TEiDEFFZjNw The key AWS services discussed in the video are: Amazon Lex Amazon Lex is a chatbot platform. It uses speech recognition and language understanding technology to analyze text and speech. Amazon Lex can be trained to recognize a users intent and carry out a conversation to collect the necessary data. Amazon Polly Amazon Polly is a text-to-speech service. You supply a string of text and Amazon Polly will return an audio file in a variety of different voices. To learn more about the features see  https://aws.amazon.com/polly/features/ . To see the currently supported languages and voices available for those languages see  https://docs.aws.amazon...
Read more

Apple Pay, Android Pay, contactless credit cards, is it safe?

Image
If you live in Canada and own a credit card you are now probably accustomed to tapping your credit card to pay for your small purchases. Canadian banks started issuing contactless credit cards in 2010, and most vendors now have pay terminals that support "Tap". Visa officially calls the contact-less credit card feature payWave  and MasterCard calls it  Tap & Go . For majority of Americans this great convenient form of payment came in 2014 with  Apple Pay  or Android Pay . Canadian banks are starting to enabling Apple Pay this  June . Apple Pay, and Android Pay use NFC. Early versions of the contactless credit cards used RFID and was a hot topic in 2012 as hackers demonstrated how the can read the data  just by standing near you with a smartphone. Since then Visa payWave and MasterCard Tap &Go have moved to using NFC. What is NFC and how is it different from RFID? NFC stands for Near Field Communication and is related to b...
Read more

How to Build a Web Services with Serverless + Typescript + DynamoDB

Image
In this article, we are focusing on the setup and use of three technologies to help you start developing Web Applications and Services. The technologies are Serverless, TypeScript and Amazon DynamoDB. Serverless Serverless is a deployment platform that focuses on providing a powerful and capable deploy system that supports multiple cloud platforms. Serverless (the platform) is not to be confused with the "serverless computing" ideology of using managed autoscaling cloud infrastructure instead of server-based cloud infrastructure.  Serverless (the platform) is an implementation of the "serverless computing" ideology.  Serverless abstracts the cloud platform-specific implementation for better usability and improved cloud portability. As a developer, this means you spend less time learning and dealing with platform-specific issues and instead learn cloud transferrable skills! Serverless is designed to be used in place of AWS CloudFormation, Azure Re...
Read more