Natural language command parsing for agricultural measurement and control based on AMR and entity recognition

Abstract

There is scope to enhance agricultural measurement and control systems user interactivity, which typically necessitates training for users to perform specific operations successfully. With the continuous development of natural language semantic processing technology, it has become essential to augment the user-friendliness of multifaceted control and query operations in the agricultural measurement and control sector, ultimately leading to reduced operation costs for users. The study aims to focus on command parsing. The proposed AMR-OPO semantic parsing framework is based on the natural language understanding method of Abstract Meaning Representation of Rooted Markup Graphs (AMR). It transforms the user’s natural language inputs into structured ternary (OPO) statements (operation-place-object) and converts the corresponding parameters of the user’s input commands. The framework subsequently sends the transformed commands to the relevant devices via the IoT gateway. To tackle the intricate task of parsing instructions, we developed a BERT-BiLSTM-ATT-CRF-OPO entity recognition model. This model can detect and extract entities from agricultural instructions, and precisely populate them into OPO statements. Our model shows exceptional accuracy in instruction parsing, with precision, recall, and F-value all measuring at 92.13%, 93.12%, and 92.76%, correspondingly. The findings from our experiment reveal outstanding and precise performance of our approach. It is anticipated that our algorithm will enhance the user experience offered by agricultural measurement and control systems, while also making them more user-friendly.

Keywords

Natural language processing abstract meaning representation entity recognition natural language understanding human-computer interaction

Get full access to this article

View all access options for this article.

References

Razali

M.H.H.

Atar

Norjihah

, Human computer interaction and application in agriculture for education;, Int. J. Inf. Technol. Comput. Sci2 (2012), 7–11.

Jansen,

, Bernard, ,The graphical user interface, ACM SIGCHI Bulletin30(2) (1998), 22–26.

Bellegarda , Jerome

, Kim Silverma

E.A.

,Natural language spoken interface control using data-driven semantic inference, IEEE Transactions on Speech and Audio Processing11(3) (2003), 267–277.

Bellegarda , Jerome

Spoken language understanding for natural interaction: The siri experience, Natural Interaction with Robots, Knowbots and Smartphones: Putting Spoken Dialog Systems into Practice (2013), 3–14.

Sarikaya

Crook

P.A.

Marin

, et al., An overview of end-to-end language understanding and dialog management for personal digital assistants, 2016 IEEE Spoken Language Technology Workshop (2016), 391–397.

Mehrabani Mahnoosh Srinivas Bangalore Stern , Personalized speech recognition for Internet of Things, 2015 IEEE 2nd World Forum on Internet of Things (2015), 33

Noura Mahda Sebastian Heil Martin Gaedke ,Natural language goal understanding for smart home environments, Proceedings of the 10th International Conference on the Internet of Things (2020), 1–8.

Feng Junlan , A general framework for building natural language understanding modules in voice search, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing (2010), 5362–5365.

Maynard

Diana Kalina Bontcheva and Isabelle Augenstein, Natural Language Processing for the Semantic Web, San Rafael: Morgan & Claypool (2017).

10.

Shen

, et al., SCADA-NLI: A natural language query and control interface for distributed systems, IEEE Access9 (2021), 7810–78127.

11.

Banarescu

Bonial

Cai

, et al., Abstract meaning representation for sembanking, Proceedings of the 7th linguistic annotation workshop and interoperability with discourse (2013), 178–186.

12.

W.G.

Zhou

, et al., Survey on abstract meaning representation, Journal of Data Acquisition & Processing32(01) (2017), 26–36.

13.

D.Q.

Gong

, et al., Does encoder of neural machine translation learn semantic information, Journal of Chinese Information Processing35(03) (2021), 60–68+77..

14.

Yang

Feng

Liu

, et al., Distant context aware text generation from abstract meaning representation, –, Applied Intelligence52(2) (2022), 1672–1685.

15.

Huang

Z.Y.

, Chinese Abstract Meaning Representation Parsing, Ph.D.Soochow University, 2021.

16.

Collobert

Weston

Bottou

, et al., Natural language processing (almost) from scratch, Journal of Machine Learning Research12 (2011), 2493–2537.

17.

Huang

, Bidirectional LSTM-CRF models for sequence tagging, arXiv preprint arXiv:1508.01991, (2015).

18.

Lample

Ballesteros

Subramanian

, et al., Neural architectures for named entity recognition, arXiv preprint arXiv:1603.01360 (2016).

19.

Chiu

J.P.C.

Nichols

, Named entity recognition with bidirectional LSTM-CNNs, Transactions of the Association for Computational Linguistics4 (2016), 357––370.

20.

Peters

M.E.

Ammar

Bhagavatula

, et al., Semisupervised sequence tagging with bidirectional language models, arXiv preprint arXiv:1705.00108 (2017).

21.

Park

Kim

, Low-cost implementation of a named entity recognition system for voice-activated human-appliance interfaces in a smart home, Sustainability10(2) (2018), 488.

22.

Dar

H.S.

Lali

M.I.

Din

M.U.

, et al., Frameworks for querying databases using natural language: a literature review, arXiv preprint arXiv:1909.01822 (2019).

23.

Jie

, Dependency-guided LSTM-CRF for named entity recognition, arXiv preprint arXiv:1909.10148 (2019).

24.

Lample

L.G.

, Ballesteros

, Subramanian

, et al., Neural architectures for named entity recognition, arXiv preprint arXiv:1603.01360 (2016).

25.

Qin

Xie

Che

, et al., A survey on spoken language understanding: Recent advances and new frontiers, arXiv preprint arXiv:2103.03095 (2021).

26.

Devlin

Chang

M.W.

Lee

, et al., Bert: Pre-training of deep bidirectional transformers for language understanding, arXiv preprint arXiv:1810.04805 (2018).

27.

Clark

Luong

M.T.

Q.V.

, et al., Electra: Pre-training text encoders as discriminators rather than generators, arXiv preprint arXiv:2003.10555 (2020).

28.

Liu

Ott

Goyal

, et al., Roberta: A robustly optimized bert pretraining approach, arXiv preprint arXiv:1907.11692 (2019).

29.

Baevski

Edunov

Liu

, et al., Cloze-driven pretraining of self-attention networks, arXiv preprint arXiv:1903.07785 (2019).

30.

Sun

Meng

, et al., Dice loss for data-imbalanced NLP tasks, arXiv preprint arXiv:1911.02855 (2019).

31.

Cao

Chen

Liu

, et al., Adversarial transfer learning for Chinese named entity recognition with selfattention mechanism, Proceedings of the 2018 conference on empirical methods in natural language processing (2018), 182–192.

32.

Zhou

J.T.

Zhang

Jin

, et al., Dual adversarial neural transfer for low-resource named entity recognition, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (2019), 3461–3471.