2
$\begingroup$

I understand the way we build a model but all of the online courses I've found end with this--I can’t find any course explaining the process utilising the model to address the problem.

  • How do I use the model to address the real world problems?

Example: I have a model to predict the KB number for the given incident. How do I integrate and use this model ?

Is there any course out there that explains the whole process from data collection, model building and utilising the model to solve the real world problems?

$\endgroup$
  • 1
    $\begingroup$ I think the courses don't explain how to use a model because it varies from case to case basis. But they do give you a general guideline of what to do if your model doesn't work. $\endgroup$ – DuttaA May 14 at 16:38
5
$\begingroup$

Using a machine learning or AI-powered model once it has been built and tested, is not directly an AI issue, it is just a development issue. As such, you won't find many machine learning tutorials that focus on this part of the work. But they do exist.

In essence it is the same as integrating any other function, which might be in a third-party library:

  • Package the new function so that it can be called from your production system (this may be the hardest part)

  • Decide where in the code of your production system to call the new function. In your example case maybe after form is completed describing an incident you could link the top recommended KB articles from the new ticket.

  • Design and check the associated user experience/UI as appropriate for your development team (in small projects you may skip this step and just implement)

  • Change your production code to call the packaged function. In any professional development team, this part will have multiple stages, but not really relevant to the question - if you are the ML specialist and delivering your new model to an existing team, you need to talk to them about both the packaging part and the steps involved here.

Often, machine learning models come with a whole bunch of dependencies that the rest of a system does not have. There are a variety of solutions for that, depending on the libraries that you are using, whether you are using a cloud PaaS service etc. You could just build a Docker image to hold all the AI parts and call it passing the input data.

Deploying ML models to production as a job is often a task for Machine Learning Engineer roles. There are courses and articles covering the practical aspects of these steps, if you search for them. Here are a couple:

I have no affiliation with any of the above, have not read articles or taken the courses, and am not able to make any recommendation, even if you told me the technologies you were using for ML and in production currently.

After deploying to production . . .

Your work is not necessarily done. You will want to monitor behaviour of the system. During integration, you should of added logging, or some way to get feedback of performance in the wild.

For instance, if this is an ML system, does the accuracy seen in testing hold up against real life? Is the target population drifting? If the system makes interventions - by e.g. suggesting links, or showing categories to end users - how well are those working in practice? Is the performance and responsiveness of the system fast enough when the service is under load?

If it is more reactive AI system, that takes actions itself, you will similarly want to monitor what it is supposed to optimise, or sample its output for errors and quality control.

All this feedback can go back into a new iteration of design and integration. How to incorporate that will depend a lot on the nature of the system and what you discover, so could be the subject of further questions.

$\endgroup$
  • $\begingroup$ It's interesting to learn that machine learning is an engineering discipline which is handled with Docker containers, and deployable models from Coursera. And the experts are able to teach the details and the only thing what the newbies have to do is to attend the right universities and take a look into existing books. Is it really that easy? Why do we need robotics competitions? $\endgroup$ – Manuel Rodriguez May 14 at 21:28
  • $\begingroup$ @ManuelRodriguez: There are differences between understanding how the model works mathematically, how to build and train it using a library, and integrating the technology. All of this knowledge is necessary to make ML and AI systems. However, many professionals specialise. In my case I build web applications, they all run on operating systems and web servers, but I don't know the first thing about writing operating systems, and I would make a very poor web server if I had to write one from scratch. Similar splits happen in ML/AI projects. $\endgroup$ – Neil Slater May 15 at 6:47

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.