General Words Representation Method for Modern Language Model

QR Code

General Words Representation Method for Modern Language Model

This paper proposes a new word representation method emphasizes general words over specific words. The main motivation for developing this method is to address the weighting bias in modern Language Models (LMs). Based on the Transformer architecture, contemporary LMs tend to naturally emphasize spec...

Full description

Bibliographic Details
Main Authors:	Abbas Saliimi, Lokman, Mohamed Ariff, Ameedeen, Ngahzaifa, Ab. Ghani
Format:	Article
Language:	English
Published:	UTeM 2023
Subjects:	QA75 Electronic computers. Computer science QA76 Computer software
Online Access:	http://umpir.ump.edu.my/id/eprint/38294/ http://umpir.ump.edu.my/id/eprint/38294/1/6241-Article%20Text-18137-1-10-20230324.pdf

Similar Items

A conceptual IR Chatbot framework with automated keywords-based vector representation generation
by: Abbas Saliimi, Lokman, et al.
Published: (2020)

A conceptual IR chatbot framework with Automated Keywords-based vector representation generation
by: Abbas Saliimi, Lokman, et al.
Published: (2020)

Question classification of CoQa (QCOC) dataset
by: Abbas Saliimi, Lokman, et al.
Published: (2021)

Modern chatbot systems: a technical review
by: Abbas Saliimi, Lokman, et al.
Published: (2019)

A Question-Answering System that Can Count
by: Abbas Saliimi, Lokman, et al.
Published: (2021)

Chatbot development in data representation for diabetes education
by: Abbas Saliimi, Lokman
Published: (2011)

A Critical Review of General Method and Game-based Method in Learning Time Dilation
by: Lok, Leh Leong, et al.
Published: (2015)

Modified word representation vector based scalar weight for contextual text classification
by: Abbas Saliimi, Lokman
Published: (2024)

Simulating Dynamic Time Dilation in Relativistic Virtual Environment
by: Abbas Saliimi, Lokman, et al.
Published: (2016)

A conceptual IR chatbot framework with automated keywords-base
by: Abbas Saliimi, Lokman, et al.
Published: (2020)

Designing a Chatbot for diabetic patients
by: Jasni, Mohamad Zain, et al.
Published: (2009)

A review on disaster prediction using machine learning
by: Farghaly, Alaa Taiseer, et al.
Published: (2024)

Component Testing for VsImaging Library Using Pixel Comparison Technique
by: Muhammad Zulfahmi Toh, Abdullah, et al.
Published: (2013)

KHACDD : A knowledge-based hybrid method for multilabel sentiment analysis on complex sentences using attentive capsule and dual structured recurrent network
by: Islam, Md Shofiqul, et al.
Published: (2024)

Sequence diagram synthesis theory for stitching together multiple sequence diagrams through formal semantics modelling
by: Ameedeen, Mohamed Ariff
Published: (2010)

Overview of Random Forest : Effective Ensemble Method in Modern Data Mining
by: Abdullah, Embong, et al.
Published: (2007)

Application block word for android user
by: Mohd Amirul Amzar, Mohd Talib
Published: (2019)

A proposed method for the semantic Similarity use WordNet to handle the ambiguity in Social Media text
by: Ali Muttaleb, Hasan, et al.
Published: (2019)

Augmented Reality English to Malay words converter
by: Nur Shafiqah Syuhada, Abdul Basik
Published: (2018)

A novel BiGRUBiLSTM model for Multilevel Sentiment Analysis Using Deep Neural Network with BiGRU-BiLSTM
by: Islam, Md Shofiqul, et al.
Published: (2021)

Visual analysis to investigate the capability of ANFIS in modelling hydrological relationship using synthetic dataset
by: Ngahzaifa, Ab. Ghani, et al.
Published: (2018)

Feature selection method based on sparse representation classification for face recognition
by: Boon, Yinn Xi *, et al.
Published: (2014)

A Model Driven Method to Represent Free Choice Petri Nets as Sequence Diagram
by: Thong , Weng Jie, et al.
Published: (2015)

Beyond words of popularization mining: Reviews on comic books movies
by: Lee, Angela Siew Hoong *, et al.
Published: (2018)

Final examination question generator using microsoft word's macro
by: Hoong, Adrian Yong Weng
Published: (2014)

Intelligent autism screening using fuzzy agent
by: Nurul Najihah, Che Razali, et al.
Published: (2020)

Road enforcement monitoring system based on vehicle type recognition using sparse filtering convolutional neural network with layer skipping strategy (SFCNNLS)
by: Suryanti, Awang, et al.
Published: (2019)

Intuitive Content Management System to Preferences Template Throughout Data Collection by using Data Mining Classification of Prediction Method
by: Chan, Chung Hoong, et al.
Published: (2016)

WebWordPro version 2.0 the web-based word processing system / Lin Koon How
by: Lin , Koon How
Published: (2000)

A design theory for holistic student self-service university management system
by: Muhamad Idaham, Umar Ong, et al.
Published: (2019)

Effectiveness of RSS feed item duplication detection using word matching
by: Tan, Ian K. T., et al.
Published: (2011)

A supervised learning neural network approach for the prediction of supercapacitive energy storage materials
by: Varun, Geetha Mohan, et al.
Published: (2022)

The need for operational reasoning in data-driven rating curve prediction
by: Mount, Nick J., et al.
Published: (2012)

A simple segmentation approach for unconstrained cursive handwritten words in conjunction with neural network
by: Khan, Amjad Rehman, et al.
Published: (2008)

Transforming education with cutting-edge technology
by: Mohamed Ariff, Ameedeen
Published: (2022)

Shape feature representation in similarity measurement for content-based image retrieval
by: Chiew, Kang Leng
Published: (2003)

A proposed method using the semantic similarity of WordNet 3.1 to handle the ambiguity to apply in social media text
by: Ali Muttaleb, Hasan, et al.
Published: (2020)

Utilizing word matching for duplicate article removal : a study using Malaysian online news feed
by: Su, Tze-Wei, et al.
Published: (2011)

Development of real-time pose estimation algorithm for Quranic Arabic word
by: Mohd Esa, Luqman Naim, et al.
Published: (2017)

Stemming engine for Bahasa Melayu words / Muhammad Aizat Abdul Rahman
by: Muhammad Aizat, Abdul Rahman
Published: (2006)