Chatting about ChatGPT: how may AI and GPT impact academia and libraries?
Brady D. Lund
References
Bishop, C. M. (1994). Neural networks and their applications. Review of Scientific Instruments,65, article 1803.
Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W.(2016). Openai gym. arXiv.
Budzianowski, P., & Vulić, I. (2019). Hello, it's GPT-2--how can I help you? towards the use of pretrained language models for task-oriented dialogue systems. arXiv.
Cherian, A., Peng, K. C., Lohit, S., Smith, K., & Tenenbaum, J. B. (2022). Are Deep Neural Networks SMARTer than Second Graders?. arXiv.
Dale, R. (2017). NLP in a post-truth world. Natural Language Engineering, 23(2), 319-324.Dale, R. (2021). GPT-3 What’s it good for? Natural Language Engineering, 27(1), 113-118.
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
Erhan, D., Bengio, Y., Courville, A., Manzagol, P., & Vincent, P. (2010). Why does unsupervised pre-training help deep learning. Journal of Machine Learning Research, 11, 625-660.
Floridi, L., & Chiriatti, M. (2020). GPT-3: Its nature, scope, limits, and consequences. Minds and Machines, 30(4), 681-694.
Goh, G., Cammarata, N., Voss, C., Carter, S., Petrov, M., Schubert, L., Radford, A., & Olah, C.(2021). Multimodal neurons in artificial neural networks.
King, M. R. (2022). The future of AI in medicine: A perspective from a chatbot. Annals of Biomedical Engineering. https://doi.org/10.1007/s10439-022-03121-wKirmani, A. R. (2022). Artificial intelligence-enabled science poetry. ACS Energy Letters, 8,574-576.Lee, C., Panda, P., Srinivasan, G., & Roy, K. (2018). Training deep spiking convolutional neural networks with STDP-based unsupervised pre-training followed by supervised fine-tuning. Frontiers in Neuroscience, 12, article 435.
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021). GPT understands,too. arXiv.
Lucy, L., & Bamman, D. (2021). Gender and representation bias in GPT-3 generated stories. Proceedings of the Workshop on Narrative Understanding, 3, 48-55.
Page 9
MacNeil, S., Tran, A., Mogil, D., Bernstein, S., Ross, E., & Huang, Z. (2022). Generating diverse code explanations using the GPT-3 large language model. Proceedings of the ACM Conference on International Computing Education Research, 2, 37-39.Manning, C., & Schutze, H. (1999). Foundations of statistical natural language processing. MITPress.
Marcus, G., Davis, E., & Aaronson, S. (2022). A very preliminary analysis of DALL-E 2. ArXivpre-print.
Mollman, S. (2022). ChatGPT gained 1 million users in under a week.
Niu, Z., Zhong, G., & Yu, H. (2021). A review on the attention mechanism of deep learning. Neurocomputing, 452, 48-62.OpenAI. (2022). OpenAI about page.
Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism and Mass Communication Educator.
Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving language understanding by generative pre-training.
Strubell, E., Ganesh, A., & McCallum, A. (2019). Energy and policy considerations for deep learning in NLP. Proceedings of the Annual Meeting of the Association for Computational Linguistics, 57, 3645-3650.
Zhou, X., Chen, Z., Jin, X., & Wang, W. Y. (2021). HULK: An energy efficiency benchmark platform for responsible natural language processing. Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, 16,329-336
(PDF) Chatting about ChatGPT: How may AI and GPT impact academia and libraries?. Available from: https://www.researchgate.net/publication/367161545_Chatting_about_ChatGPT_How_may_AI_and_GPT_impact_academia_and_libraries [accessed Mar 04 2024].