Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data analytics in ecommerce
    Analytics Technology Drives Conversions for Your eCommerce Site
    5 Min Read
    CRM Analytics
    CRM Analytics Helps Content Creators Develop an Edge in a Saturated Market
    5 Min Read
    data analytics and commerce media
    Leveraging Commerce Media & Data Analytics in Ecommerce
    8 Min Read
    big data in healthcare
    Leveraging Big Data and Analytics to Enhance Patient-Centered Care
    5 Min Read
    instagram visibility
    Data Analytics Plays a Key Role in Improving Instagram Visibility
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Why Sentiment Analysis Engines Need Customization
Share
Notification Show More
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Sentiment Analytics > Why Sentiment Analysis Engines Need Customization
AnalyticsSentiment AnalyticsSocial Media AnalyticsText AnalyticsUnstructured Data

Why Sentiment Analysis Engines Need Customization

lexalytics
Last updated: August 6, 2014 5:29 pm
lexalytics
4 Min Read
Image
SHARE

ImageThere was a time, not too long ago, when the general population would have bet their life savings that flying cars and human-like robots would exist by the year 2014.

There are definitely no flying cars, and robots aren’t exactly how we pictured them. However, we do have artificial intelligence that can understand what people are saying.

Creepy? Sort of, but more cool than creepy in my opinion.

ImageThere was a time, not too long ago, when the general population would have bet their life savings that flying cars and human-like robots would exist by the year 2014.

More Read

Image

The Beginner’s Guide to Hadoop

TwitPolls: Some Relevance for Enterprise Technologists
A Question of Scope
The Future of Customer Service
Top Big Data Skills To Help You Stand Out from the Crowd

There are definitely no flying cars, and robots aren’t exactly how we pictured them. However, we do have artificial intelligence that can understand what people are saying.

Creepy? Sort of, but more cool than creepy in my opinion.

When artificial language is used to understand human (natural) language, it’s referred to as natural language processing (NLP). Most NLP engines that are used to analyze text come equipped with something called sentiment analysis, which is a technology that lets us know whether text is positive, negative or neutral.

Good NLP engines will be able to assign sentiment to a single word or phrase. “Awful”, for example, is a word with negative sentiment. “Delicious” is positive and “Blue chair” is neutral.

Sentiment analysis can also tell us the polarity of an entire document. For example, a tweet that reads, “The service was awful but the food was delicious!” would be neutral. That’s because the positive and the negative cancel out to make for a neutral score.

Really good NLP engines will give you a sentiment score for the individual words and phrases that bear sentiment, and another score for the entire document as a whole. So in the example above, we would know that the tweet is neutral, but it contains valuable positive and negative information.

The problem with sentiment analysis is sometimes it’s wrong. It’s just a limitation that we have to deal with. I mean, humans can’t agree on the polarity of a document half the time. Even grad students won’t agree 20% of the time.

“Oh man, that was nasty!” Is this sentence positive or negative?

Surely, it must be negative. “Nasty” is a negative word, and everything else in this sentence is neutral. Final answer, negative! Drum role…

Wrong! It’s positive.

The person who said this used the American slang definition of nasty, which has positive sentiment. There is absolutely no way to know by reading the sentence. So, if you (a human) were just tricked by reading this article, how is a machine supposed to figure it out? Answer: Tell the engine what’s positive and what’s negative.

High quality NLP engines will let you customize your sentiment analysis settings. “Nasty” is negative by default. If you’re processing slang where “nasty” is considered a positive term, you would access your engine’s sentiment customization function, and assign a positive score to the word.

The better NLP engines out there will make this entire process a piece of cake. Without this kind of customization, the machine could very well be useless in your work. When you choose a sentiment analysis engine, make sure it allows for customization.

Otherwise, you’ll be stuck with a machine that interprets everything literally, and you’ll never get accurate results.

Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

trusted data management
The Future of Trusted Data Management: Striking a Balance between AI and Human Collaboration
Artificial Intelligence Big Data Data Management
data analytics in ecommerce
Analytics Technology Drives Conversions for Your eCommerce Site
Analytics Exclusive
data grids in big data apps
Best Practices for Integrating Data Grids into Data-Intensive Apps
Big Data Exclusive
AI helps create discord server bots
AI-Driven Discord Bots Can Track Server Stats
Artificial Intelligence Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Expert Panel on Challenges and Solutions

3 Min Read

Course: Financial Data Modeling and Analysis in R

1 Min Read

The Emerging Role of the Analyst – Posts from the Blogosphere

1 Min Read

Would IBM buying Sun impact the decision management market? Nope.

4 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
ai chatbot
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-24 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?