I've designed a machine learning model for the predictive maintenance of machines. The data used for training and testing the ML model is the data from various sensors connected to various parts of the machines. Now, I'm searching for a good approach for deploying the model in the real-time environment as explained here. I did some research and found some information about using real-time data for prediction such as using Kafka. I have some questions unanswered regarding the deployment of the ML model. Following are the details of my system:

  • The sensors (pressure, temperature, flow, vibration, etc) are deployed across the parts of the machines.
  • The ML model is trained with historical data.
  • For predictive maintenance (anomaly detection), streams of data will be available via MQTT. As there are 3000 machines, the volume of data will be very high.

My questions are:

  • Where will be the best place to perform prediction operation, at the factory premice where machines are located (edge computing), at our office (that designs ML model), or at cloud server? I want to know it in regard to operational cost.
  • Is there any way to estimate the effectiveness of the complete system (full-stack ML architecture)?
  • $\begingroup$ These seem to be more-so questions of machine learning engineering than machine learning theory. ML engineering is a cross between software engineering and data science, and the role (of the so-called 'machine learning engineer') is more-so one of implementing machine learning models (than conceiving of statistical models to be used for some purpose, as the data scientist does). I doubt you'll get answers to such questions on this website. ML engineering itself is relatively new and does not have much formal theory (compared to, say, pure software engineering). [...] $\endgroup$ Jul 5, 2021 at 16:07
  • $\begingroup$ [...] This mlebook.com/wiki/doku.php is a recently published textbook on ML engineering (that I have purchased but not read) by Andriy Burkov; I suggest you read this as a starting point. $\endgroup$ Jul 5, 2021 at 16:27


You must log in to answer this question.

Browse other questions tagged .