Step 1: Collect Data
Given the problem you want to solve, you will have to investigate and obtain data that you will use to feed your machine. The quality and quantity of information you get are very important since it will directly impact how well or badly your model will work. You may have the information in an existing database or you must create it from scratch. If it is a small project you can create a spreadsheet that will later be easily exported as a CSV file. It is also common to use the web scraping technique to automatically collect information from various sources such as APIs.
Step 2: Prepare the data
This is a good time to visualize your data and check if there are correlations between the different characteristics that we obtained. It will be necessary to make a selection of characteristics since the ones you choose will directly impact the execution times and the results. You can also reduce dimensions by applying PCA if necessary.
Additionally, you must balance the amount of data we have for each result -class- so that it is significant as the learning may be biased towards a type of response and when your model tries to generalize knowledge it will fail.
You must also separate the data into two groups: one for training and the other for model evaluation which can be divided approximately in a ratio of 80/20 but it can vary depending on the case and the volume of data we have.
At this stage, you can also pre-process your data by normalizing, eliminating duplicates, and making error corrections.
.ub62a7277ac32afa5c024a4844cbe60bc { padding:0px; margin: 0; padding-top:1em!important; padding-bottom:1em!important; width:100%; display: block; font-weight:bold; background-color:#eaeaea; border:0!important; border-left:4px solid #34495E!important; box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -moz-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -o-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -webkit-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); text-decoration:none; } .ub62a7277ac32afa5c024a4844cbe60bc:active, .ub62a7277ac32afa5c024a4844cbe60bc:hover { opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; text-decoration:none; } .ub62a7277ac32afa5c024a4844cbe60bc { transition: background-color 250ms; webkit-transition: background-color 250ms; opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; } .ub62a7277ac32afa5c024a4844cbe60bc .ctaText { font-weight:bold; color:inherit; text-decoration:none; font-size: 16px; } .ub62a7277ac32afa5c024a4844cbe60bc .postTitle { color:#000000; text-decoration: underline!important; font-size: 16px; } .ub62a7277ac32afa5c024a4844cbe60bc:hover .postTitle { text-decoration: underline!important; } Also Read Advanced text mining by extracting insights from various forums helps in addressing and analyzing customer feedbackStep 3: Choose the model
There are several models that you can choose according to the objective that you might have: you will use algorithms of classification, prediction, linear regression, clustering, i.e. k-means or K-Nearest Neighbor, Deep Learning, i.e Neural Networks, Bayesian, etc.
There are various models to be used depending on the data you are going to process such as images, sound, text, and numerical values. In the following table, we will see some models and their applications that you can apply in your projects:
ModelApplicationsLogistic RegressionPrice predictionFully connected networksClassificationConvolutional Neural NetworksImage processingRecurrent Neural NetworksVoice recognitionRandom ForestFraud DetectionReinforcement LearningLearning by trial and errorGenerative ModelsImage creationK-meansSegmentationk-Nearest NeighborsRecommendation systemsBayesian ClassifiersSpam and noise filtering
Step 4 Train your machine model
You will need to train the datasets to run smoothly and see an incremental improvement in the prediction rate. Remember to initialize the weights of your model randomly -the weights are the values that multiply or affect the relationships between the inputs and outputs- which will be automatically adjusted by the selected algorithm the more you train them.
Step 5: Evaluation
You will have to check the machine created against your evaluation data set that contains inputs that the model does not know and verify the precision of your already trained model. If the accuracy is less than or equal to 50%, that model will not be useful since it would be like tossing a coin to make decisions. If you reach 90% or more, you can have good confidence in the results that the model gives you.
.u6c9950a41f8096d0a4a4b8aba48c4229 { padding:0px; margin: 0; padding-top:1em!important; padding-bottom:1em!important; width:100%; display: block; font-weight:bold; background-color:#eaeaea; border:0!important; border-left:4px solid #34495E!important; box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -moz-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -o-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -webkit-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); text-decoration:none; } .u6c9950a41f8096d0a4a4b8aba48c4229:active, .u6c9950a41f8096d0a4a4b8aba48c4229:hover { opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; text-decoration:none; } .u6c9950a41f8096d0a4a4b8aba48c4229 { transition: background-color 250ms; webkit-transition: background-color 250ms; opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; } .u6c9950a41f8096d0a4a4b8aba48c4229 .ctaText { font-weight:bold; color:inherit; text-decoration:none; font-size: 16px; } .u6c9950a41f8096d0a4a4b8aba48c4229 .postTitle { color:#000000; text-decoration: underline!important; font-size: 16px; } .u6c9950a41f8096d0a4a4b8aba48c4229:hover .postTitle { text-decoration: underline!important; } Also Read How To Create URL Shortening Library In PythonStep 6: Parameter Tuning
If during the evaluation you did not obtain good predictions and your precision is not the minimum desired, it is possible that you have overfitting -or underfitting problems and you must return to the training step before making a new configuration of parameters in your model. You can increase the number of times you iterate your training data- termed epochs. Another important parameter is the one known as the “learning rate”, which is usually a value that multiplies the gradient to gradually bring it closer to the global -or local- minimum to minimize the cost of the function.
Increasing your values by 0.1 units from 0.001 is not the same as this can significantly affect the model execution time. You can also indicate the maximum error allowed for your model. You can go from taking a few minutes to hours, and even days, to train your machine. These parameters are often called Hyperparameters. This “tuning” is still more of an art than a science and will improve as you experiment. There are usually many parameters to adjust and when combined they can trigger all your options. Each algorithm has its own parameters to adjust. To name a few more, in Artificial Neural Networks (ANNs) you must define in its architecture the number of hidden layers it will have and gradually test with more or less and with how many neurons each layer. This will be a work of great effort and patience to give good results.
Step 7: Prediction or Inference
You are now ready to use your Machine Learning model inferring results in real-life scenarios.
.u7b180e8b2a6bb85c045672fbd2e48d4d { padding:0px; margin: 0; padding-top:1em!important; padding-bottom:1em!important; width:100%; display: block; font-weight:bold; background-color:#eaeaea; border:0!important; border-left:4px solid #34495E!important; box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -moz-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -o-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -webkit-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); text-decoration:none; } .u7b180e8b2a6bb85c045672fbd2e48d4d:active, .u7b180e8b2a6bb85c045672fbd2e48d4d:hover { opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; text-decoration:none; } .u7b180e8b2a6bb85c045672fbd2e48d4d { transition: background-color 250ms; webkit-transition: background-color 250ms; opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; } .u7b180e8b2a6bb85c045672fbd2e48d4d .ctaText { font-weight:bold; color:inherit; text-decoration:none; font-size: 16px; } .u7b180e8b2a6bb85c045672fbd2e48d4d .postTitle { color:#000000; text-decoration: underline!important; font-size: 16px; } .u7b180e8b2a6bb85c045672fbd2e48d4d:hover .postTitle { text-decoration: underline!important; } Also Read Top 6 Python Libraries For Cyber-DefendersProvide your comments below comments
Source: https://analyticsindiamag.com/the-7-key-steps-to-build-your-machine-learning-model/
