ARTICLE
TITLE

Neural Network Pruning in Unsupervised Aspect Detection based on Aspect Embedding

SUMMARY

 Aspect detection systems for online reviews, especially based on unsupervised models, are considered better strategically to process online reviews, generally a very large collection of unstructured data.  Aspect embedding-based deep learning models are designed for this problem however they still rely on redundant word embedding and they are sensitive to initialization which may have a significant impact on model performance. In this research, a pruning approach is used to reduce the redundancy of deep learning model connections and is expected to produce a model with similar or better performance. This research includes several experiments and comparisons of the results of pruning the model network weights based on the general neural network pruning strategy and the lottery ticket hypothesis. The result of this research is that pruning of the unsupervised aspect detection model, in general, can produce smaller submodels with similar performance even with a significant amount of weights pruned. Our sparse model with 80% of its total weight pruned has a similar performance to the original model. Our current pruning implementation, however, has not been able to produce sparse models with better performance.

 Articles related

Jason Alexander,Daniel Ronaldo Pangestu,Ferdy Nicolas,Lukman Hakim    

Artificial Neural Network (ANN) is a branch of Artificial Intelligence which possesses great potential. However, ANN has a huge drawback: the need for complex parameters to train a developed ANN in order to provide the right solution to the proposed prob... see more


Ani Rahmani,Muhammad Edwin    

A film is one of the entertainment media in human life. It makes the film industry becomes a potential business to get promising income. Prediction of success of a film financially supports film producers, production houses, distributors, and stakeholder... see more


Cristina Cristina,Ade Kurniawan    

A neural network is a form of artificial intelligence that has the ability to learn, grow, and adapt in a dynamic environment. Neural network began since 1890 because a great American psychologist named William James created the book "Principles of Psyco... see more


Hasan Huseyin Yildirim,Mehmet Yavuz    

Countries aiming for sustainability in economic growth and development ensure the reliability of energy supplies. For countries to provide their energy needs uninterruptedly, it is important for domestic and renewable energy sources to be utilised. For t... see more


Yasas Senarath,Nadheesh Jihan,Surangika Ranathunga    

Aspect Extraction from consumer reviews has become an essential factor for successful Aspect Based Sentiment Analysis. Typical user trends to mention his opinion against several aspects in a single review; therefore, aspect extraction has been tackled as... see more