The MyCity chatbot, launched as a pilot program, aims to assist business owners with information from NYC Business webpages. However, a report revealed the chatbot's inaccuracies in providing legal advice, such as misinformation on Section 8 vouchers and worker regulations. The chatbot's token-based predictive models can lead to incorrect responses due to gaps in training data. While warnings acknowledge the potential for harmful content, the chatbot is marketed as a tool to navigate government for business owners. The report underscores the risks of deploying chatbots without ensuring accuracy, with examples from Air Canada and tax preparation software. Source: https://arstechnica.com/ai/2024/03/nycs-government-chatbot-is-lying-about-city-laws-and-regulations/ submitted by /u/Nuse...