Human Activity Recognition is technology introduced to recognize human activities. Several technologies that have been applied are Accelerometer sensors, Gyroscope sensors, Cameras, and GPS. The selection of the Support Vector Machine algorithm is due to its capabilities to minimize errors in training data sets and the Curse of dimensionality which can estimate parameters as well as its ability to find the best hyperplane that separates two classes. The SVM algorithm was originally developed for the classification of two classes. Problem raised if there are more than two classes. In addition, the performance will not optimal for the large-scale data. Therefore, modification the current design is needed. An ensemble technique can be used to combine the Support Vector Machine algorithm with the bagging algorithm. This study proposes the application of an ensemble SVM algorithm to classify human activities based on accelerometers and gyroscope sensors on smartphones. The total data is 13725 records with 4575 representatives of each class. From the results of the overall data partition carried out in the calcification process using the ensemble SVM algorithm, the best performance was generated when comparing datasets with 80% training data and 20% test data from a total of 13725 records because it succeeded in increasing accuracy, precision, and sensitivity.