Can a Computer Recognize Signs of Depression from Social Media Photos?

Curated by Claudia Shannon / Research Scientist / ishonest

Researchers used photos to find signs of depression on social media posts. However, there are concerns about privacy rights and treatment recommendations.

Identifying people with depression can be difficult even for trained professionals.

ishonest No.231 - Pigmentation & Blemishes

No.231 - Pigmentation & Blemishes

Now, researchers are looking at the possibility that a computer could do a better job.

However, experts have some concerns about patient privacy and appropriate treatment recommendations if this research starts to be used in the real world.

Depression affects millions of people in the United States every year. Sixteen million adults experienced one major depressive episode in 2015, according to the National Institute of Mental Health.

Spotting depression in people can be difficult, with primary care physicians missing signs in patients about half the time, according to the American Psychiatric Association.

How the research was conducted

Fade brown spots away

Learn more

The subjects included 71 people with a history of clinical depression.

The researchers looked at how often a user posted photos, how many people were in the photos, whether or not they used filters, and if the picture’s saturation had been affected.

They found certain patterns were more present in people with a history of depression than other users.

Danforth also pointed out that people with a history of depression were more likely to use the black-and-white filter and were more likely to post more often.

ishonest No.232 - Pigmentation & Blemishes

No.232 - Pigmentation & Blemishes

Additionally, photos that were darker with blue and grayer tones were more associated with users who had a history of depression.

Once they put these findings into an algorithm, the computer program was able to correctly identify about 70 percent of the depressed users.

The researchers acknowledge that this study is just a first step and that depression is complex, often coinciding with other conditions such as anxiety, bipolar disease, or chronic pain, among others.

Ramani Durvasula, PhD, a psychologist and professor at California State University Los Angeles, said she thought the study was interesting. But she was skeptical that a computer program could help people with the condition.

Protect your skin from UV rays, photoageing and hormonal changes causing hyperpigmentation

Learn more

“Depression is not just one thing. It’s pretty complicated,” she told ishonest.

Durvasula said she was also concerned that if social media companies — which are private businesses — start to use these programs to identify users likely to be depressed, it may not lead to those users getting appropriate treatment.

“Here’s the rub, is what do you tell people, if they are depressed? she said. “We don’t always agree on what is the right treatment for depression.”

Durvasula said she was worried that the companies would sell data on potentially depressed users. These people could then start to get marketing for antidepressant medications without getting any information on counseling.

ishonest No.181 - Post-Sun Exposure

No.181 - Post-Sun Exposure

She also worried that these findings would not translate across multiple demographic groups and cultures.

“We always looked for a magical blood test,” for depression, she said. “I’m not sure this is going to be it.”

Pamela Rutledge, PhD, said she was fascinated by the study and how it linked back to some visual techniques used in psychology, like the Rorschach “ink blot” test.

“What I find really interesting about it [is] I find image very reflective of what goes on in the whole person,” Rutledge explained.

While she thought the study was interesting, she also said there needs to be far more research done to see if these findings would hold up for larger populations.

“I would be very cautious about going right to ‘We can diagnose people,’” Rutledge told ishonest. “Just as humans are fallible, tools are, too.”

Read more on: spots

Learn about unknown needs of your skin for free