Home » » What is feature engineering?

What is feature engineering?

Just read a post from http://blog.bigml.com/2013/02/21/everything-you-wanted-to-know-about-machine-learning-but-were-too-afraid-to-ask-part-two/
What is Feature Engineering?
teachFeature Engineering is the Keyer_key
We’ll start out this time with a topic that is so important that it deserves an instructive example. In fact, Domingos calls it “easily the most important factor” in determining the success of a machine learning project, and I agree with him.
Suppose you have a dataset in which you have pairs of cities, coupled with a prediction of whether most people would consider the two cities to be comfortably drivable within a single day. You’ve got a nice database with the longitudes and latitudes for all of your cities, and so these are your input fields. Your dataset might look something like this (note that the values don’t correspond to actual city locations – they are random):
CITY 1 LAT.CITY 1 LNG.CITY 2 LAT.CITY 2 LNG.DRIVABLE?
123.2446.71121.3347.34Yes
123.2456.91121.3355.23Yes
123.2446.71121.3355.34No
123.2446.71130.9947.34No
And you expect to construct a model that can predict for any two cities whether the distance is drivable or not.
Probably not going to happen.
The problem here is that no single input field, or even any single pair of fields, is closely correlated with the objective. It is a combination of all four fields (the distance from one pair of geo-coordinates to the other), and a combination by a fairly complex formula, that is correlated with the input. Machine learning algorithms are limited in the way they can combine input fields; if they weren’t, they could totally exhaust themselves trying everything.
But all is not lost! Even if the machine doesn’t have any knowledge about how longitudes and latitudes work, you do. So why don’t you do it? Apply the formula to each instance and get a dataset like this (again, random values):
DISTANCE (MI.)DRIVABLE?
14Yes
28Yes
705No
2432No
Ah. Much more manageable. This is what we mean by feature engineering. It’s when you use your knowledge about the data to create fields that make machine learning algorithms work better.
Domingos mentions that feature engineering is where “most of the effort in a machine learning project goes”. I couldn’t agree more. In my career, I would say an average of 70% of the project’s time goes into feature engineering, 20% goes towards figuring out what comprises a proper and comprehensive evaluation of the algorithm, and only 10% goes into algorithm selection and tuning.
How does one engineer a good feature? One good rule of thumb is to try to design features where the likelihood of a certain class goes upmonotonically with the value of the field. So in our example above, “drivable = no” is more likely as distance increases, but that’s not true of longitude or latitude. You probably won’t be able to engineer a feature where this is strictly true, but it is a good feature even if it is somewhat close to that ideal.
Typically, there isn’t a single data transformation that makes learning immediately easy (as there was in the above example), but at least as typically there are one or more things you can do to the data to make machine learning easier. There’s no formula for this, and a lot of it happens by itch and by twitch. BigML attempts to do some of the easy ones for you (automated date parsing is an example) but far more interesting transformations can happen with detailed knowledge of your specific data. Great things happen in machine learning when human and machine work together, combining a person’s knowledge of how to create relevant features from the data with the machine’s talent for optimization.

81 Comments:

Maria Lena said...

Feature engineering is the way toward utilizing space information to separate highlights from crude information through information mining procedures. These highlights can be utilized to improve the exhibition of AI calculations. Highlight building can be considered as applied AI itself. law essay writing service

Ariel Wilson said...

I am a writer in and provide the lecture on law dissertation topics and your blog is really helpful for me so thank you so much for sharing your experience with us.

Unknown said...

Amazing post, Thanks for sharing this wonderful information!
Top Dissertation Writing Services UK

Data Science Course in Bangalore said...

Actually I read it yesterday I looked at most of your posts but I had some ideas about it . This article is probably where I got the most useful information for my research and today I wanted to read it again because it is so well written.
Data Science Course in Bangalore

Rona Wedmore said...

Feature engineering is quite interesting and fun to do as I have studied it all my life, however I took a different elective this semester of accounting for more credit hours and have no idea what to do as I have an assignment to write up. After weeks of despair and searching I googled best accounting essay writers UK and found my knight in shining armor to save me from this trouble. Now I have the best grade and can relax easily.

Website Development Company said...

I always like to read a quality content having accurate information regarding the subject and the same thing I found in this post.

Website Development Company |

Craigslist Posting Service for Car Dealers said...

Great information, i was searching of this kind of information, thank you very much for sharing with us.

Craigslist Posting Service for Car Dealers |

Lubbock moving company said...

This is really amazing website that I have been found on google regarding website Blog Commenting sites. and I would like to thank admin who also given us to post the link on his side.

Lubbock moving company |

Car Auction Software said...

This was something I was looking for, really helpful, and great work is done. Thank you so much for sharing such valuable information.

Car Auction Software |

Best CRM for Small Businesses said...

It’s really a cool and helpful piece of information. I am glad that you shared useful information with us. Please keep us up to date like this. Thanks for sharing.

Best CRM for Small Businesses |

Web Development Company in Gwalior said...

I am really like it very much for the interesting info in this blog that to this website is providing the wonderful info in this blog that to utilize the great technology in this blog.

Web Development Company in Gwalior |

Marriage Garden in Gwalior said...

Thank you very much for writing this blog. It was very easy to understand.

Marriage Garden in Gwalior |

sri said...

Thanks for sharing this.,
Leanpitch provides online training in CSPO during this lockdown period everyone can use it wisely.
Join Leanpitch 2 Days CSPO Certification Workshop in different cities.

CSPO certification

Product owner certification

sri said...

Thanks for sharing this.,
Leanpitch provides online training in CSPO during this lockdown period everyone can use it wisely.
Join Leanpitch 2 Days CSPO Certification Workshop in different cities.
CSPO certification online

Certified scrum product owner

sri said...

Thanks for sharing this.,
Leanpitch provides online training in CSPO during this lockdown period everyone can use it wisely.
Join Leanpitch 2 Days CSPO Certification Workshop in different cities.
CSPO online certification

CSPO certification cost

sri said...

Thanks for sharing this.,
Leanpitch provides online training in CSPO during this lockdown period everyone can use it wisely.
Join Leanpitch 2 Days CSPO Certification Workshop in different cities.
CSPO TRAINING ONLINE

CSPO ONLINE TRAINING

sri said...

Thanks for sharing this.,
Leanpitch provides online training in CSPO during this lockdown period everyone can use it wisely.
Join Leanpitch 2 Days CSPO Certification Workshop in different cities.
CSPO TRAINING

CSPO ONLINE

Dakota Leest said...

Such an interesting story. You are a great writer. Keep up sharig valuable pieces of information. You can also check out the string theory essay The article is also very enlightening.

Data Analytics Course said...

Excellent Blog! I would like to thank you for the efforts you have made in writing this post. Gained lots of knowledge.
Data Analytics Course

AI Courses said...

What an incredible message this is. Truly one of the best posts I have ever seen in my life. Wow, keep it up.
AI Courses in Bangalore

Data Science Courses said...

Awesome article. I enjoyed reading your articles. this can be really a good scan for me. wanting forward to reading new articles. maintain the nice work!
Data Science Courses in Bangalore

Business Analytics said...

I am sure it will help many people. Keep up the good work. It's very compelling and I enjoyed browsing the entire blog.
Business Analytics Course in Bangalore

Isabell Kiral said...

This field has a big scope and new students can adjust to it easily. If you are worried about your future, you should join this field and enjoy a secure future. Masters dissertation writing service.

sri said...


Thanks for sharing this.,
Leanpitch provides crash course in Brain hacks using NLP everyone can use it wisely.

Brain hacks with NLP

NLP training

sri said...


Thanks for sharing this.,
Leanpitch provides crash course in Brain hacks using NLP everyone can use it wisely.
NLP training

NLP crash course

Data Science Training in Bangalore said...

You have completed certain reliable points there. I did some research on the subject and found that almost everyone will agree with your blog.

Data Science Training in Bangalore

Machine Learning Course in Bangalore said...

I have voiced some of the posts on your website now, and I really like your blogging style. I added it to my list of favorite blogging sites and will be back soon ...

Digital Marketing Training in Bangalore

Machine Learning Course in Bangalore said...

The Extraordinary blog went amazed by the content that they have developed in a very descriptive manner. This type of content surely ensures the participants explore themselves. Hope you deliver the same near the future as well. Gratitude to the blogger for the efforts.

Machine Learning Course in Bangalore

Artificial Intelligence Training in Bangalore said...

I found Habit to be a transparent site, a social hub that is a conglomerate of buyers and sellers willing to offer digital advice online at a decent cost.

Artificial Intelligence Training in Bangalore

My Dissertations said...

You have finished certain solid focuses there. I did some examination regarding the matter and found that nearly everybody will concur with your blog. Do My Dissertation For Me

zoey said...

How does one go about designing an excellent feature? One excellent rule of thumb is to try to develop features that increase the possibility of a certain class in lockstep with the field's
Finance Writing Services
value. In our example, “drivable = no” becomes more likely as distance grows, but this is not the case for longitude or latitude.

Morrello said...

I ordered a diploma work in logistics from https://ratewritingservices.com/review/essaysprofessors-com-review.html In addition, I immediately ordered a speech with a presentation. I needed at least 80% originality

Writing-Service said...

Hello, I am Eva, and my essay critiquing these problems I am writing now includes feature engineering. I will be glad to communicate with you on this issue.

Unknown said...

I'm happy to read your blog. I often use additional services for my university studies. I started using the custom essays service. It helps me be a better student. I can get help with essays at any time.

MARKETING ASSIGNMENT HELP said...

If you want someone to Edit my paper within the shortest period of time, then get our assistance from experts who are available for support. We make sure that every content is of the best quality and is composed according to your requirements and necessities. You can also get additional deals and discounts on special occasions throughout the year.

Purple Arrow LLC said...

Amazing website, Love it. Great work done. Nice website. Love it. This is really nice.
office.com/setup
Mcafee.com/activate
Microsoft365.com/setup
office.com/myaccount
ij.start.canon

Liam said...

Running out of time? Struggling to understand the homework questions? Is it too tough for you to master the key concepts? All these problems have one solution – assistance from homework experts. Students often ask us “should I take my online class?” And, we always respond “yes”. Instead of continuing the struggle without any improvement will lead to inevitable failure. Thus, we always advice young minds to find a mentor who can help in finishing their task within the deadlines and guiding with the subject as well. If you were confused until now, we hope that this passage has cleared your doubts.

modular partition for office said...

modular partition for office are a configuration of walls that are pre-assembled into your desired design. These Industrial Doors systems can then be quickly put into place when and where a private office, meeting room, or conference room is needed.

Assignment Help said...

Reading is my passion. That’s why I become super crazy to see what new is going in your post. I want to see interact you with the navigational link of Assignment Help service.

lucifer1413 said...

Amazon Prime Video is really a paid subscription-based platform so people with out a subscription aren't practiced to see such a thing in family savings for the stage. Even the www.amazon.com/code application isn't difficult to do some thing to for every income of those eligible platforms so you won't track down any hardship even though triggering your apparatus. This informative article you are going to find out just how to log in amazon.com/code and the way exactly to coming your apparatus into watching amazon.com/code Prime Videos articles.
Disneyplus.com/begin |
Facebook login |
Omegle |
Hbomax.com/tvsignin |

Sophia Williams said...

Here I am for the first time, and I found beneficial information. Very nice and well-explained article. Thanks for sharing!
mcafee.com/activate | mcafee.com/activate | geek squad appointment

hillgibson said...

Marketing offers a number of perspectives, incorporating a number of areas such as market analysis, advertising strategy, product promotion, public relations, retail sales, e-commerce, market management and Retail Governance. The students are also facing challenges with collecting their marketing courses, because of their variety of theoretical underpins. In the case of marketing findings in research, it becomes difficult to absorb economic concepts, management, corporate finance and other disciplines at once. Service provider of 'Pay Someone to Take My Online Class' service will guide you to the online marketing classes, with appropriate and revised examples.

technoblogs said...

A Quick Guide to Canon Printer SetupMake sure your printer hardware is configured.
On your PC browser, go to cannon.com/ijsetup
Click Set Up.
Using your Canon IJ printer model, the download printer software.
Double click to install it.
Connect a network to your printer and PC.
Finish the Canon IJ printer setup.
HP LaserJet Printer Setup
Configure your HP Printer hardware.
Visit 123.hp.com/laserjet from the browser.Using your LaserJet model name, download software.Double click to start the installation.Connect the printer via wireless network or USB.Add the LaserJet printer to your system devices.Finish the HP LaserJet setup.

technoblogs said...

microsoft365.com/setup allows you to download and activate the Microsoft Office setup. Microsoft 365 plans for personal and home provides robust Office desktop apps including Word, PowerPoint, Excel, Outlook, and OneNote.Microsoft 365 subscribers can always install the latest version of MS Office and get frequent software updates. If you have a Microsoft account, sign in and enter the product key at microsoft365.com/setup to activate your product. Install and set up your Office 365 apps with the given instructions.

mack zayn said...

Microsoft 365 or Office on your computer. If you are using any other Microsoft service such as OneDrive, Outlook, Skype, or Xbox Live, it means you already have an account that you can use for any Microsoft activity.
Microsoft365.com/setup
Microsoft365.com/setup
www.microsoft365/setup

finley jordan said...


Canon Pixma MG 2522 is an all-in-one inkjet printer equipped with multifunctional features like printer, scanner, and copier.
Canon.com/ijsetup/mg2522 |
Canon.com/ijsetup mg2522
| microsoft365.com/setup

finley jordan said...

Defend against the unknown threats and proceed for Trend micro download with www.trendmicro.com/activate having Advanced Machine Learning Technology. Trend micro security is the best way to save your Connected World to all the digital part. Install www.trendmicro/activate from the official site and get the trend micro activation key to complete the process.

Bhuvankumar said...

I feel very grateful that I read this. It is very helpful and very informative and I really learned a lot from it.
Data Analytics Course

Data Science Training in BLR said...

Really impressed! Everything is a very open and very clear clarification of the issues. It contains true facts. Your website is very valuable. Thanks for sharing.

Digital Marketing Training in Bangalore

Dev Kumar said...

I am sure it will help many people. Keep up the good work. It's very compelling and I enjoyed browsing the entire blog.
Business Analytics Course in Bangalore

Artificial Intelligence Training in BLR said...

You have completed certain reliable points there. I did some research on the subject and found that almost everyone will agree with your blog.

Artificial Intelligence Training in Bangalore

Anonymous said...

The perfect way to get started with microsoft365.com/setup is gathering enough information and purchasing depending on your requirement. You can then easily download and install the software package by visiting .

Anonymous said...


Canon printers are ideal for every situation wherever you need a document, paper, or photo print or even if you wish to scan, fax, and do more ijstart.canon will make you learn how to set up a canon printer to get advanced printing features ij.start.canon , ij.start.cannon .

kumal kumar said...

What an incredible message this is. Truly one of the best posts I have ever seen in my life. Wow, keep it up.
AI Courses in Bangalore

henrynikk07 said...

A new purchased (or older) Canon printer needs to be set up.https://ij.start.cannon | https //ij.start.cannon | http://ij.start.cannon
PIXMA MG2522 all-in-one printer is the best choice for all home printing needs and small businesses as well. First, visit canon.com/ijsetup mg2522 | canon.com/ijsetup/mg2522
Use your Outlook, Skype, Xbox or any other Microsoft account to sign in. To avoid any error during Microsoft 365 installation, follow the instructions mentioned below. microsoft365.com/setup | www.microsoft365.com/setup

James Smith said...

If you’d like to guest post in the "submit guest post" + "fitness", below are some blogs that are willing to accept your post. If you’re looking for blogs outside of the finance niche, you cancheck out our list of blogs that accept guest posts in other niches.

Tech Institute said...

I am really enjoying reading your well written articles. I am looking forward to reading new articles. Keep up the good work.
Data Science Courses in Bangalore

Machine Learning Course in BLR said...

Happy to chat on your blog, I feel like I can't wait to read more reliable posts and think we all want to thank many blog posts to share with us.

Machine Learning Course in Bangalore

Data Science Training in BLR said...

I wanted to leave a little comment to support you and wish you the best of luck. We wish you the best of luck in all of your blogging endeavors.

Data Science Training in Bangalore

Mark William said...

Use your Microsoft account through microsoft365.com/setup for everything you want to with Microsoft 365. Create an account or use the account of services such as OneDrive, Skype, Outlook, or Xbox Live. Use the site microsoft365.com/setup to download and install Microsoft 365 setup that will allow you to use multiple apps like Word, Excel, OneNote, PowerPoint, or more.

Mark William said...

The Canon printer that can be downloaded via canon.com/ijsetup page is the best wireless printer that you can connect to your device and print data smoothly. Ij.start canon CD is not the well-suited technique to use ij.start.canon installation for longer. One can canon.com/ijsetup/mg2522 install from another origin if your device is having issues in the online installation or any other.Use ij.start cannon to set up your Canon product.Get started to Canon inkjet setup with guidelines of ij.start.cannon site.

andremariyo said...

We are not Amazon. This website is for information purposes only. For more help, visit
amazon.com/mytv
amazon code
amazon com code
amazon.com/code
amazon.com/us/code

andremariyo said...

It is important to remember that Amazon Prime Video is not compatible with every streaming device. Perhaps this is due to the fact that Amazon Prime Video is still relatively new. The service is still available on many devices.
amazon.com/us/code
amazon code
www.amazon.com/code
prime video.com/mytv
amazon com code

Majortotosite Pro said...

That is a very good tip particularly to those new to
the blogosphere. Brief but very accurate information… Thanks for sharing
this one. A must read post! 메이저사이트

Racesite Pro said...

Hi Good day
It was really useful for me
Thanks for putting it on your site
I come to your site every week – thank you 경마사이트

Oncasinosite Net said...

This article provides clear idea designed for the new visitors
of blogging, that genuinely how to do blogging. 카지노사이트

Totopick Pro said...

Hi there, yeah this post is truly nice and I have learned
lot of things from it about blogging. thanks. 사설토토

trainingcourses said...

I want to say thanks to you. I have bookmark your site for future updates.
data science training

RentaPC: Laptop Rental | Macbooks | Desktops @Lowest Price Delhi | India said...

Hi,
That's Great & Giving so much information after reading your blog.
Great thanks to you
All It Equipment on Rent
Laptop and Desktop Available on rent at Affordable Prices in PAN INDIA

Rent A PC

Unknown said...

Thanks for posting the best information and the blog is very helpful.

Artificial Intelligence Training in Bangalore | Artificial Intelligence Online Training

Python Training in Bangalore | Python Online Training

Data Science Training in Bangalore | Data Science Online Training

Machine Learning Training in Bangalore | Machine Learning Online Training

AWS Training in bangalore | AWS Online Training

UiPath Training in Bangalore | UiPath Online Training

Max Turner said...

Visit www.hp.com/go/wirelessprinting and open the door to the world of HP smart printing solutions. HP wireless printer is a versatile printing device that helps you print, scan, copy and fax your documents as per the requirement.
Visit ij.start.canon | ij.start canon and find out the best way to download Canon printer drivers. Canon printers are ideal for every situation wherever you need a document, paper, or photo print or even if you wish to scan, fax, and do more ijstart.canon will make you learn how to set up a canon printer to get advanced printing features.

ethan potter said...

A Quick Guide to Canon Printer SetupMake sure your printer hardware is configured.
On your PC browser, go to cannon.com/ijsetup
Click Set Up.
Using your Canon IJ printer model, the download printer software.
Double click to install it.
Connect a network to your printer and PC.
Finish the Canon IJ printer setup.

finley jordan said...

Canon Pixma MG 2522 is an all-in-one inkjet printer equipped with multifunctional features like printer, scanner, and copier.
Canon.com/ijsetup/mg2522 |
Canon.com/ijsetup mg2522

Allen said...

Canon printers are ideal for every situation wherever you need a document, paper, or photo print or even if you wish to scan, fax, and do more i Ij.start canon
ij.start.canon

reword my essay said...

If you had been wondering if you essays or assignments can be given a cosmetic makeover to make it more impressive and out of league. reword my essay is the online service that makes it happen. These applications keep the content and soul of the paper unchanged but replace words with an impressive vocabulary and better references and citations. Various services available on internet can assist students in their essay writing projects.

ankit singh said...

MMA training aims to make you learn how to defeat your opponent using techniques of throwing, striking and grappling. MMA classes in Dehradun | best martial arts training in dehradun

Professional Course said...

Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

Machine Learning Training in Bangalore

Jennifer Garner said...

Can’t find online exam help? Just tell us Take My Exam For Me and pay someone to do my online exam with take your class online.

Essien said...


Great article! This is the kind of info that are meant to be shared around the internet. I'm interesting updates. Come on over and talk over with my site wusto post utme past questions for medicine

ethan potter said...

A Quick Guide to Canon Printer SetupMake sure your printer hardware is configured.
On your PC browser, go to cannon.com/ijsetup
Click Set Up.
Using your Canon IJ printer model, the download printer software.
Double click to install it.
Connect a network to your printer and PC.
Finish the Canon IJ printer setup.
microsoft365.com/setup allows you to download and activate the Microsoft Office setup. Microsoft 365 plans for personal and home provides robust Office desktop apps including Word, PowerPoint, Excel, Outlook, and OneNote.

Max Turner said...

Visit www.hp.com/go/wirelessprinting and open the door to the world of HP smart printing solutions. HP wireless printer is a versatile printing device that helps you print, scan, copy and fax your documents as per the requirement.
Visit ij.start.canon | ij.start canon and find out the best way to download Canon printer drivers. Canon printers are ideal for every situation wherever you need a document, paper, or photo print or even if you wish to scan, fax, and do more ijstart.canon will make you learn how to set up a canon printer to get advanced printing features.

Popular Posts