ChatGPT’s New Safety Feature Could Alert ‘Trusted Contact’ to Risk of Self-Harm


OpenAI launched an optional safety feature this week called Trusted Contact, which lets adult ChatGPT users nominate a friend or family member to be notified if there are discussions of self-harm or suicide on the chatbot, the company announced

OpenAI said that if ChatGPT’s automated monitoring system detects that the user “may have discussed harming themselves in a way that indicates a serious safety concern,” a small team will review the situation and notify the contact if it warrants intervention. The designated safety contact will receive an invitation in advance explaining the role and can decline. 

(Disclosure: Ziff Davis, CNET’s parent company, in 2025 filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.)

The announcement comes as AI chatbots have been implicated in numerous incidents of self-harm and fatalities, resulting in several lawsuits accusing developers of failing to prevent such outcomes. In one high-profile California case, parents of a 16-year-old said ChatGPT acted as their son’s “suicide coach,” alleging that the teenager discussed suicide methods with the AI model on several occasions and that the chatbot offered to help him write a suicide note. 

In a separate case, the family of a recent Texas A&M graduate sued OpenAI, claiming the AI chatbot encouraged their son’s suicide after he developed a deep and troubling relationship with the chatbot. 

Since large language models mimic human speech through pattern recognition, many users form emotional attachments to them, treating them as confidants or even romantic partners. LLMs are also designed to follow a human’s lead and maintain engagement, which can worsen mental health dangers, especially for at-risk users. 

OpenAI said last October that its research found that more than 1 million ChatGPT consumers per week send messages with “explicit indicators of potential suicidal planning or intent.” Numerous studies have found that popular chatbots like ChatGPT, Claude and Gemini can give harmful advice or no helpful advice to those in crisis. 

The new designated contact feature comes after OpenAI rolled out parental controls that enable parents and guardians to get alerts if there are danger signs for their teen children.

ChatGPT’s safety contact feature

According to OpenAI, if ChatGPT’s automated monitoring system detects that a user is discussing self-harm in a way that could pose a serious safety issue, ChatGPT will inform the user that it may notify their trusted contact. The app will encourage the user to reach out to their trusted contact and offer conversation starters.

At that point, a “small team of specially trained people” will review the situation. If it’s determined to be a serious safety situation, ChatGPT will notify the contact via email, text message or in-app notification. OpenAI did not specify how many people are on the review team nor whether it includes trained medical professionals. The company said that the team has the capacity to meet a high demand of possible interventions.

It’s unclear which key terms would flag dangerous conversations or how OpenAI’s team of reviewers would interpret a crisis as warranting notification of the contact. Some online commentators question whether the new feature is a way for OpenAI to avoid liability and to shift responsibility onto users’ designated personal contacts. Others note that it could make a bad situation worse if the “trusted contact” is the source of danger or abuse. 

There are also concerns about privacy and implementation, particularly regarding the sharing of sensitive mental health information. According to OpenAI, the message to the trusted contact will only give the general reason for the concern and will not share chat details or transcripts. OpenAI offers guidance on how trusted contacts can respond to a warning notification, including asking direct questions if they are worried the other person is contemplating suicide or self-harm and how to get them help.

Three screenshots of a phone. The first one includes three different ways to receive a Trusted Contact notification. The second screenshot explains to the Trusted Contact that the user may be struggling mentally. The third screenshot advises the Trusted Contact on how to help.

Notifications to a Trusted Contact do not contain details of the safety concern.

OpenAI

OpenAI gives an example of what the message to the trusted contact might look like:

We recently detected a conversation from [name] where they discussed suicide in a way that may indicate a serious safety concern. Because you are listed as their trusted contact, we’re sharing this so you can reach out to them.

OpenAI said that all notifications will be reviewed by the human team within 1 hour before they are sent out and that notifications “may not always reflect exactly what someone is experiencing.”

How to add a trusted contact

To add a trusted contact, ChatGPT users can go to Settings > Trusted contact and add one adult (18 or older). You can have only one trusted contact. That person will then receive an invitation from ChatGPT and must accept it within one week. If they don’t respond or decline to become the contact, you can select a different contact.

ChatGPT customers can change or remove their trusted contact in their app settings. People can also opt out of being a trusted contact at any time.

Even though adding a trusted contact is optional, ChatGPT users who have not already opted in might see enrollment prompts if they ask about or discuss topics related to severe emotional distress or self-harm more than once over a period of time, according to OpenAI. If the chatbot’s automated system identifies patterns across conversations, it might suggest to the user that they would benefit from choosing a trusted contact.

Details of the feature are explained on OpenAI’s page. OpenAI told CNET that the feature is rolling out to all adult customers worldwide and will be available for everyone within a few weeks.

If you feel like you or someone you know is in immediate danger, call 911 (or your country’s local emergency line) or go to an emergency room to get immediate help. Explain that it is a psychiatric emergency and ask for someone who is trained for these kinds of situations. If you’re struggling with negative thoughts or suicidal feelings, resources are available to help. In the US, call the National Suicide Prevention Lifeline at 988.





Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


Top IT Companies In India

The following is the list of top IT companies in India that offer many users secure, reliable, user-friendly, and robust IT services.

Tata Consultancy Services (TCS)

TCS is one of the top 10 IT companies in India, a Tata Group company, and is well known across the globe. The company offers various IT services to many of its clients. TCS was started in the year 1968 by Tata Sons. Currently, TCS is headed by Mr. Rajesh Gopinathan, but soon Mr. K. Krithivasan will take over the position of MD and CEO of TCS by Jun ’23.

Tata Consultancy Services (TCS) is an Indian Multinational company headquartered in Mumbai. The company operates worldwide, covering 46 countries with 150 locations under the Tata Group. Many leading news reports informed that TCS is recognized for its employee-friendly workplace, developing the best talents across the company through multiple skill development programs and initiatives. It is an equal-opportunity employer and offers the best salary packages.

TCS (Tata Consultancy Services) currently holds around 5,56,000 employees in 150 locations. It also includes more than 2 Lakh women employees contributing to its growth. Moreover, the company’s net margin by the March ’23 quarter stood at 19.3%, and the revenue increased to Rs. 59,162 crores. The total market cap of TCS is around Rs. 11.52 trillion.

A skilled Software Engineer in TCS company earns a decent salary of Rs. 3.6 to 13.5 lakhs p.a. with an annual average salary of Rs. 6.3 lakhs, according to AmbitionBox.

Infosys

Another one among the top list of IT companies in India is Infosys. It was founded in 1981 in Pune and is HQ in Bengaluru. Infosys emerged as a global leader in providing digital and consulting services, business outsourcing, and IT services for next-generation. Mr. N.R. Narayana Murty, Nandan Nilekani, and others started it. Moreover, Infosys is an NYSE-listed IT company with over 3 lakh employees. It generated a revenue of USD 18.21 billion in the fiscal year 2023 with a market cap of USD 72.35 billion.

It is the first IT company from India which is listed on NASDAQ. Infosys has spread its wings to more than 190 companies across the globe. The company primarily provides various IT services in cloud computing, data analytics, IoT, testing, app development, cyber security, and more.

A software engineer at Infosys in India earns between Rs. 3.5 to 20 lakhs per year with an average annual salary of Rs. 7.7 lakhs, according to Ambitionbox.

Become a master of IoT by going through this HKR IoT Online Training!

IoT Training

  • Master Your Craft
  • Lifetime LMS & Faculty Access
  • 24/7 online expert support
  • Real-world & Project Based Learning

Wipro Limited

Wipro Limited is among India’s top 10 IT companies, leading in offering in-demand digital transformation services. Also, it looks after various customer needs across the globe. However, Wipro is the short form of Wester India Products, established in 1945 by MD Premji. Initially, it was established as a manufacturing company of vegetable and refined oils, gradually entering into diversified businesses. Now, it is one of the best IT companies in India, with a market cap of more than Rs. 2 lakh Cr and possesses more than 2 lakh employees.

Wipro offers multiple IT services in Data Analytics, Cyber Security, Digital Operations, AI, Consulting, and more.

Further, the company’s net worth stood at 24.21 Billion USD in 2023. It offers equal employment opportunities across different sectors, including IT. A software engineer at Wipro earns a salary of Rs. 3.6 to 12 lakhs per year with an average annual salary of Rs. 7 lakhs p.a.

HCL Technologies

Hindustan Computers Limited, or HCL Technologies, is among India’s top 10 IT companies. It was established in 1976 by Shiv Nadar and is headquartered in Noida. HCL Tech has 180 global locations and nearly 1,70,000 employees working here.

The market cap of HCL Tech is around Rs. 2.85 trillion. By the end of March ’23, the company has crossed the revenue of Rs. 1 lakh crores by growing its industry-leading services by 16%. Moreover, HCL Tech helps in business transformation with a wide range of services like digital workplace, networking, hybrid cloud services, cyber security, etc. Apart from IT services, it also offers BPO, infrastructure, etc. It contributes more towards the country’s economic growth by providing an industrial and startup ecosystem for new IT services.

The salary of an SDE (Software Engineer) at HCL Tech ranges between Rs. 4.8 lakhs to Rs. 17 Lakhs p.a. The average annual salary of an SDE at this company is around Rs. 9 lakhs per annum. However, the pay may vary with the position and experience level.

Tech Mahindra

It is another Indian MNC that offers IT consulting and services. Tech Mahindra provides a wide range of services through its diverse businesses like farm equipment manufacturing, financial services, utility vehicles, IT services, etc. Further, it offers customer-centric, innovative digital services. It was founded in 1986 by Anand Mahindra, with headquarters in Pune as a part of the Mahindra Group.

The total revenue of Tech Mahindra is more than Rs. 38,600 Crores. Moreover, Tech Mahindra offers a wide range of IT services such as cloud services, IT consulting, AI, data analytics, cyber security, next-gen managed services, 4G/5G services, networking services, BPS, etc.

The salary of a Software engineer at Tech Mahindra ranges between Rs. 4.2 to 9.5 lakhs per year with an average pay of Rs. 5.4 lakhs p.a.

Wish to make a career in the World of Cyber Security ? Then Start with Cyber Security Training !

Generals, top-it-companies-in-india-description-0, Generals, top-it-companies-in-india-description-1

Subscribe to our YouTube channel to get new updates..!

MindTree Ltd

Among the best IT companies in India, Mindtree Ltd. comes under the top 10 IT companies. It is also an IT services and consulting company with headquarters in Bangalore. It was established in 1999 by a group of IT professionals. Further, it was acquired by L&T in 2019, and later, by merging with L&T Infotech, it became LTIMindTree in 2022.

LTIMindtree has nearly 40,000 employees in India. After merging with LTI, it became the 5th largest IT company with USD 5.25 Billion in revenue in 2022. Currently, it is headed by Debashish Chatterjee (CEO).

LTIMindTree offers various IT services, such as digital transformation, IT outsourcing, cloud services, consultancy, analytics, AI/ML, IoT, and many others. A skilled Software Developer at LTIMindTree earns an annual salary of Rs. 4 lakhs to 11 lakhs p.a. with an average pay of Rs. 6.9 lakhs p.a.

MPhasis

MPhasis is one of the top IT services and consulting companies which is an Indian Multinational founded in 1998. Its current CEO is Nitin Rakesh since 2017. It is headquartered in Bengaluru, with nearly 30,000 employees working there. Further, Mphasis holds a total of 65 branches across the globe. This company also offers various IT and consulting services, including cloud, blockchain, cyber security, automation, DevOps, BPS, and more.

The company MPhasis generated a total revenue of Rs. 9,700 crores in 2021. It’s a mid-cap company in the IT sector with Rs. 42,149 Cr. The salary of a Software Engineer at Mphasis is between Rs. 4 to 12 lakhs per year, with an average annual salary of Rs 6.3 lakhs.

Hexaware Technologies

Hexaware Technologies is one of the Top IT companies HQ in Navi Mumbai and was founded in 1990. The company is into a wide range of IT and BPS companies, where 30,000 people work to scale digital transformation quickly.

It is creating great value for its customers with innovative technology services. It helps its employee stay productive and engaged with happiness. The company has crossed its first 1 billion US$ in revenue in 2022.

The various IT services it offers customers include IoT, cloud services, autonomous testing, data visualization, app security, and more. Moreover, the average annual salary of a Software Engineer at Hexaware Tech is around Rs. 5 LPA, ranging between Rs. 4 to 10 lakhs p.a.

Quess Corp

Quess Corp was founded in 2007 as a leading business services provider which offers a wide range of tech-enabled services like staffing and managed outsourcing. It provides services for multiple processes such as sales and marketing, telecom operations, security management, IT services, HR operations, etc. The company is HQ in Bengaluru, and CBSS (Conneqt Business Solutions) is its subsidiary.

It operates with more than 25 branches globally, with over 3 lakh employees. The revenue of Quess Corp is around Rs. 11K crores. It offers multiple roles and responsibilities to individuals with relevant skills and qualifications.

eSparkBiz

eSparkBiz is one of the top IT companies in India that offers various IT and digital transformation services. It provides services to multiple companies and unique software and IT outsourcing services.

It was founded in 2010 and emerged as a web and app development company HQ in Ahmedabad, Gujarat. It is a popular web designing company with a great team of 300+ employees. Compared to other giant IT companies, the salaries paid by eSparkBiz are low. The average annual salary of a professional at eSparkBiz ranges between Rs. 3 to 4 lakhs p.a.

Become a Devops Certified professional by learning this HKR Devops Training !

IoT Training

Weekday / Weekend Batches

Bottom Line

We have discussed the top 10 IT companies in India that are into a wide range of IT and consulting services. Many other best IT companies are operating in India. These include IBM, Accenture, Cognizant, Genpact, etc. These companies also provide a variety of IT and Non-IT services to their clients across the globe. We can see multifold growth in the IT industry in the last decade. Also, with the growing number of internet users, IT services may increase. However, the top IT companies in India dominate the global IT sector.

Related Articles:

Time Management Techniques

IoT Projects

TOP 10 JOB ORIENTED PROFESSIONAL COURSES



Source link