IBM Watson retrieve and rank service

I disagree the industry stopped looking to hire computer science majors. In 21st century, every companies need to have a website to introduce their company, product and service. A lot of companies even provide their own service in app in either apple store or android store. Some big companies they have to build a database to store all their product and user information. The most important part is companies need hire people who major in computer science to do that, so I do not think the industry stopped looking for computer scientist. One of the sexiest job of the 21 century is data scientist. Dr. Thomas said, “if your organization stores multiple petabytes of data, if the information most critical to your business resides in forms other than rows and columns of numbers, or if answering your biggest question would involve a ‘mashup’ of several analytical efforts, you need a big data scientist.” (p. 72)

watson

However, I found IBM Watson has a great ability to deal with huge unstructured data. According to Huma (2011), “In 2011, IBM Watson achieved remarkable success winning an unrestricted question-answer exhibition match competing against humans in Jeopardy, a US TV quiz show.” (p. 1) That is the first time Watson showed his power in question-answers in front of the public. Therefore, how IBM Watson can help computer scientist as a tool to deal with a huge amount of unstructured data what is what I am going to talk about.

In 2016, 80% of all data today is unstructured, so No-SQL is getting more and more popular and we need a tool to analyze those unstructured data. In this particle area, I found out Watson is doing a great job. There is service called retrieve and rank in Watson, what it does is it combines two information retrieval components in a single service. This combination provides users with more relevant results by automatically reranking them by suing these machine learning algorithms. Therefore, we can use this service to a number of information retrieval scenarios. For example, a project manager finding domain experts from a professional services organization to build out a project team.

Watson System is described as a deep question-answer technology. All data will be read as natural language in order to general the retrieval result. Peter (2011) explains that Watson’s system, “relies on massive amounts of data, spread over hundreds of computers, as well as a sophisticated mechanism for combining evidence from multiple sources” (p. 4) Therefore, Watson can general the most retrieval result base on massive amount of data. The more data we input to train the system, the more accuracy result we can get.

In my honor project, it is about I need to developed a system to general a best answer how a normal puppy becomes a professor guide dog. Since there are too many dependences, we have to come up with a machine learning system to deal with different situation base on the data we have. Therefore, we are able to general better answer base on more data we can get in the feature. Watson’s retrieve and rank service is the best fit in my project, so I am sure I will use this service in my project and even further projects in the future.

 

Word Cited:

Davenport, T. H., & Partil, D. J. (2012). Data Scientist: The Sexiest Job of the 21st Century. Retrieved February 28, 2016, from http://128.255.244.58/strategic/articles/data_scientist-the_sexiest_job_of_the_21st_century.pdf

Norvig, P. (2011). The Machine Age – Watson takes on humans at Jeopardy!. But how close are we to a computer that thinks?

Shah, H. (2011). Turing’s misunderstood imitation game and IBM’s Watson success. York, UK: AISB.

 

Leave a comment