Wednesday, September 4, 2013

The Future of Big Data is Cognitive Big Data Apps



Volume, Velocity, Variety and Veracity of your data, the 4V challenge, has become untamable.  Wait, yet another big data blog?  No, not really.  In this blog, I would like to propose a cognitive app approach that can transform your big-data problems into big opportunities at a fraction of the cost.

Everyone is talking about big data problems but not many are helping us in understanding big data opportunities.  Let's define a big data opportunity in the context of customers because growing customer base, customer satisfaction and customer loyalty is everyone’s business:

  • you have a large, diverse and growing customer base
  • your customers are more mobile and social than ever before
  • you have engaged with your customers where ever they are: web, mobile, social, local
  • you believe that "more data beats better algorithms" and that big data is all data
  • you wish to collect all data - call center records, web logs, social media, customer transactions and more so that
  • you can understand your customers better and how they speak of and rank you in their social networks
  • you can group (segment) your customers to understand their likes and dislikes
  • you can offer (recommend) them the right products at the right time and at the right price
  • you can preempt customer backlash and prevent them for leaving (churn) to competitors and taking their social network with them (negative network effects)
  • all this effort will allow you to forecast sales accurately, run targeted marketing campaigns and cut cost to improve revenues and profitability
  • you wish to do all of this without hiring an army of data analysts, consultants and data scientists
  • and without buying half-dozen or more tools, getting access to several public / social data sets and integrating it all in your architecture
  • and above all, you wish to do it fast and drive changes in real time
  • And most importantly, you wish to rinse and repeat this approach for the foreseeable future
There are hardly any enterprise solutions in the market that can address the challenges listed above.  You have no other choice but to build a custom solution by hiring several consultants and striking separate licenses agreements with public and social data vendors to get a combined lens on public and private data.  This approach will be cost prohibitive for most enterprise customers and as "90% of the IT projects go" will be mired with delays, cost overruns and truck load of heartache. 

The advances in technologies like in-memory databases and graph structures as well as democratization of data science concepts can help in addressing the challenges listed above in a meaningful and cost-effective way.  Intelligent big data apps are the need of the hour.  These apps need to be designed and built from scratch keeping the challenges and technologies such as cognitive computing[1] in mind.  These apps will leave the technology paradigms of 1990s like "data needs to be gathered and modeled (caged) before an app is built" in the dumpster and will achieve the flexibility required from all modern apps to adapt as the underlying data structures and data sources change.  These apps can be deployed right off the shelf with minimum customization and consulting because the app logic will not be anchored to the underlying data-schema and will evolve with changing data and behavior.

The enterprise customers will soon be asking for a suite of such cognitive big data apps for all domain functions so that they can put the big data opportunities to work to run their businesses better than their competitors.  Without dynamic cognitive approach in apps, addressing the 4V challenge will be a nightmare and big data will fail to deliver its promise.

Stay tuned for future blogs on this topic including discussions on a pioneering technology approach.

[1] Cognitive computing is the ability to analyze oceans of data in context with related information and expertise.  Cognitive systems learn from how they’re used and adjust their rules and results dynamically.  Google search engine and knowledge graph technology is predicated upon this approach.  

 This blog has benefited from the infinite wisdom and hard work of my former colleagues Ryan Leask and Harish Butani and that of my current colleagues Sethu M., Jens Doerpmund and Vijay Vijayasankar.

Image courtesy of  MemeGenerator

49 comments:

  1. Wonderful blog & good post.Its really helpful for me, awaiting for more new post. Keep Blogging!


    Hadoop Course in Chennai

    ReplyDelete
  2. IPL T20 news are updated regularly in http://www.coimbatoreblogs.co.in/category/sports/

    ReplyDelete
  3. I have been following you for a couple of months now but this is my first time commenting on a blog post. Thank you for sharing your knowledge and experience with us. Keep up the good work. Already bookmarked for future reference.
    Hadoop Training in Chennai
    Hadoop Training
    Best Hadoop Training in Chennai
    Best Hadoop Training Institute in Chennai

    ReplyDelete
  4. qtp training in chennai
    Wow! That's really great information guys.I know lot of new things here. Really great contribution.Thank you ...

    ReplyDelete
  5. Tremendous post building article. I read this article Big data programming concepts and I'll execute the coding step by steps for the outputs.I learn for much more new information for big data.I suggested to my friend also.
    We have to learn for Seo Related to click Seo Training in Chennai
    Seo Training Institute

    ReplyDelete

  6. This blog explains the details about changing the ways of doing that business. That is understand well and doing some different process. Provides he best output of others. Thanks for this blog.

    iOS App Development Company

    ReplyDelete
  7. Your thinking toward the respective issue is awesome also the idea behind the blog is very interesting which would bring a new evolution in respective field. Keep update more information.
    Interior Designers in Chennai

    ReplyDelete
  8. Everybody is talking about microservices. Industry veterans may remember monolithic or SOA-based solutions being the way of doing things. Times have changed. New tools have allowed developers to focus on specific problems without adding excessive complexity to deployment or other administrative tasks that are usually associated with isolated services.
    Microservices training in chennai

    ReplyDelete
  9. This comment has been removed by the author.

    ReplyDelete
  10. Thanks for appreciating. Really means and inspires a lot to hear from you guys.I have bookmarked it and I am looking forward to reading new articles. Keep up the good work..Believe me, This is very helpful for me.
    Fleet Management Software

    ReplyDelete
  11. I do agree with all the ideas you have presented in your post. They’re really convincing and will certainly work. Still, the posts are very short for newbies. Could you please extend them a little from next time?..Keep this great work..
    Journal Of Computer Science
    Journal Of Management
    Plagiarism service
    Engineering Journal
    Journal Of Chemistry

    ReplyDelete

  12. This information is impressive; I am inspired with your post writing style & how continuously you describe this topic. After reading your post, thanks for taking the time to discuss this, I feel happy about it and I love learning more about this topic

    Hadoop training institutes in chennai | Big data Hadoop Certification in chennai | Hadoop Training in Velachery | Hadoop Training in OMR | Hadoop Training with Placements

    ReplyDelete
  13. Thanks for such a great article here. I was searching for something like this for quite a long time and at last I’ve found it on your blog. It was definitely interesting for me to read about their market situation nowadays. Well written article Thank You for Sharing with Us project management courses in chennai | pmp training class in chennai | pmp training fee | project management training certification | project management training in chennai | project management certification online |

    ReplyDelete
  14. Quickbooks enterprise support Phone number
    Call the QuickBooks Enterprise phone number for 24 hours support for the Enterprise QuickBook. We are ready to solve QuickBooks Enterprise issues through the QuickBooks Enterprise Support Group. Please contact QuickBook Support Team (+1 (833) 400-1001) for help from a certified QuickBooks specialist.

    ReplyDelete
  15. Quickbooks enterprise support

    Use QuickBooks Enterprise Support Team to fix QuickBooks Enterprise Issues. Please contact QuickBooks Support Team (+1 (833) 400-1001) for help from a certified QuickBooks specialist.

    ReplyDelete
  16. Webroot is a security software which is universally famous for giving best quality protection services. At Webroot Support , you will get 24/7 assistance by qualified technicians.

    ReplyDelete
  17. HP is a well-known brand when it comes to printers. HP provides unique features but still there are some technical glitches such as overheating issue, configurations etc. Reach our HP printer support today and get quick support from our professional team.

    ReplyDelete
  18. Brother printers are the product of Japanese MNC headquartered in Nagoya, Japan. Brother manufacture wide range of printers for home and office based. Brother printers offers the fastest speed and amazing printer quality among all other printers in the market. Call our Brother printer support team for any assistance when you are facing any issue in your Brother printer.

    ReplyDelete
  19. Epson printers is the growing brand all around the world. When we are planning to buy printers, Epson is one among the names which comes to our mind. Epson printers are known for their speed, printing quality and other outstanding features. Dial our epson printer toll-free number for getting round the clock support for your Epson printer problems.

    ReplyDelete
  20. I have read your excellent post. This is a great job. I have enjoyed reading your post first time. I want to say thanks for this post. Thank you...
    showbox android

    ReplyDelete
  21. I feel very grateful that I read this. It is very helpful and very informative and I really learned a lot from it.

    freemobdroapkdownload.com/mobdro-apk-download/

    ReplyDelete
  22. This is also a very good post which I really enjoyed reading. It is not every day that I have the possibility to see something like this..


    fresh-apks.com/repelisplus-apk-download

    ReplyDelete
  23. I am really enjoying reading your well written articles. purity test

    ReplyDelete
  24. I am always searching online for articles that can help me. There is obviously a lot to know about this. I think you made some good points in Features also. Keep working, great job
    gbwhatsapp download laptop

    ReplyDelete
  25. The material and aggregation is excellent and telltale as comfortably.

    rice purity score meaning

    ReplyDelete
  26. I would recommend my profile is important to me, I invite you to discuss this topic…

    how to remove supersu

    ReplyDelete
  27. Here at this site really the fastidious material collection so that everybody can enjoy a lot.

    checkiqamaonline.com/iqama-application-family

    ReplyDelete
  28. Hey! Mind-blowing blog. Keep writing such beautiful blogs. In case you are struggling with issues on QuickBooks software, dial QuickBooks Customer Support Phone Number (877)948-5867. The team, on the other end, will assist you with the best technical services.

    ReplyDelete
  29. Hey! Mind-blowing blog. Keep writing such beautiful blogs. In case you are struggling with issues on QuickBooks software.

    quickbooks-error-1304











    ReplyDelete
  30. Hey! Lovely blog. Your blog contains all the details and information related to the topic. In case you are a QuickBooks user, here is good news for you. You may encounter any error like QuickBooks Error, visit at QuickBooks Customer Service for quick help.

    ReplyDelete
  31. Hey! Nice Blog, I have been using QuickBooks for a long time. One day, I encountered QuickBooks Customer Service in my software, then I called QuickBooks Customer Service Number. They resolved my error in the least possible time.

    ReplyDelete
  32. Excellent blog!!! I got to know more useful information by reading your blog. Thanks for posting this blog.

    Spark Training In Bangalore
    Apache Spark Training in Bangalore

    ReplyDelete
  33. Hey! Lovely blog. Your blog contains all the details and information related to the topic. In case you are a QuickBooks user, here is good news for you. You may encounter any error like QuickBooks Error, visit at QuickBooks Customer Service Number for quick help.

    ReplyDelete
  34. Hey! What a wonderful blog. I loved your blog. QuickBooks is the best accounting software, however, it has lots of bugs like QuickBooks Error. To fix such issues, you can contact experts via QuickBooks Customer Service (855)963-5959.

    ReplyDelete
  35. Great work! It is the best thing that I have read on the internet today. Moreover, If you encounter any error while working on QuickBooks software , do contact this QuickBooks Customer Service Number (855)963-5959 number for quick assistance.

    ReplyDelete
  36. This is beneficial Information for me Thanks For Sharing Such as Information .Kindly Go Through QuickBooks Support Phone Number +1 866-448-6293 For any Best QuickBooks Customer Service

    ReplyDelete