Urban75 Home About Offline BrixtonBuzz Contact

Bad AI in the wild thread

In today’s column, I explore the intriguing proposition of conversing with a future self via modern-day generative AI. The idea is that you can have generative AI pretend to be your future self and then have a lively interaction between the current you and the future you. It is almost like traveling into the future, though avoiding the difficulty of coming up with an H.G. Wells type of elaborate time machine.


Oh for gods sake. Just fuck off. Just nonsense.

the_fast_show_s2e1_commodore_pet2001_1.jpg
 
It’s impossible to compare Nabla’s AI-generated transcript to the original recording because Nabla’s tool erases the original audio for “data safety reasons,” Raison said.

Nabla said the tool has been used to transcribe an estimated 7 million medical visits.

Saunders, the former OpenAI engineer, said erasing the original audio could be worrisome if transcripts aren’t double checked or clinicians can’t access the recording to verify they are correct.

“You can’t catch errors if you take away the ground truth,” he said.

Nabla said that no model is perfect, and that theirs currently requires medical providers to quickly edit and approve transcribed notes, but that could change.


AI transcription service invents words / medical records. Open AI say to not use it for "high risk domains".

That warning hasn’t stopped hospitals or medical centers from using speech-to-text models, including Whisper, to transcribe what’s said during doctor’s visits to free up medical providers to spend less time on note-taking or report writing.

In other words, to save money.
 

AI transcription service invents words / medical records. Open AI say to not use it for "high risk domains".



In other words, to save money.

Ohhhh.
That probably explains some of the stuff in N's letters from his psychiatrist, he's baffled and sometimes angered by them, because they contain stuff he's never said (I was invited into 1 session with him and can confirm that the follow up letter was wildly inaccurate about some points).

(He is unlikely to do anything about it, but I was aware that I'd been badly misrepresented and contacted the psychiatrist myself to request correction of the incorrect parts attributed to me - this stuff goes on peoples' medical records ffs).
 
Ohhhh.
That probably explains some of the stuff in N's letters from his psychiatrist, he's baffled and sometimes angered by them, because they contain stuff he's never said (I was invited into 1 session with him and can confirm that the follow up letter was wildly inaccurate about some points).

(He is unlikely to do anything about it, but I was aware that I'd been badly misrepresented and contacted the psychiatrist myself to request correction of the incorrect parts attributed to me - this stuff goes on peoples' medical records ffs).

More likely to be c/p from other case notes, or use of boilerplate, which is rife among consultants in all clinical disciplines.
 
Latest bad AI thing is to take a natural or man made lovely site and to make it garish brightly coloured or make the narrow, windy village street even narrower and windier so it's somehow supposed to be more amazinger when it's lovely in the first place.

I wonder if people visiting Santorini have complained yet that there isn't really a street that is a waterslide.

FB_IMG_1730324918295.jpg :facepalm:
 
Pinterest has got infected.

I only noticed this when I accepted the US version of a search term I was using and some obviously AI generated pictures came up.

Then I started looking back at the board I was creating and lost confidence in all of the content.

Perhaps if you're just looking at colour schemes it doesn't matter. Perhaps real photos are so enhanced it doesn't make much difference.

:hmm: :hmm: :hmm:
 
Another newish thing seems to be (boring) Halloween anecdotes written and illustrated by AI. Like 'This kind boy decorated his elderly neighbour's house for Halloween!' With a picture of a kid no older than 3 outside one broken down looking house and then a ... similar house that's decorated for Halloween. And where said 3 year old also seems to have repainted the whole thing, replaced the roof and windows and added a new chimney. :D
 
A recent manifestation seems to be starting up or taking over FB pages about a music style, films, photography and basically getting AI to waffle on about the band/film/photo in question. Eg 'Smith's photo of the dancing girl was taken in Bristol in 1952 .... This photo evokes the nostaligic feelings of joy and being care-free....' etc, etc
 
AI companies want you to think their AI will magically replace all those annoying human employees. In reality, AI runs on low-paid labor — lots of it. Actual people are needed to tag and label photos and classify text.

60 Minutes did a great show on this last Sunday. Kenyan classifiers have been working for two years to expose what’s going on behind the curtain. [CBS; YouTube]

US wages are too high, so the richest companies in the world turn to countries with low-wage populations, such as Kenya — with an English-speaking workforce and high unemployment.

OpenAI, Facebook, Google, and Microsoft don’t hire directly. They outsource to vendors such as Sama. This insulates their reputations from the frequently abusive labor practices — even as they dictate them. OpenAI pays Sama $12.50/hour. The workers get $2/hour or less.

The jobs are draining. Deadlines are unrealistic and punitive. Workers have mere seconds to complete complicated labeling tasks. “Honestly, it’s like modern-day slavery,” one worker told 60-Minutes. “We were walking on eggshells,” said another.

Some workers are forced to view violent scenes of rape, murder, bestiality, and incest for hours a day. [Guardian, 2023]

Worth bearing in mind next time you're tempted to use it.
 

Worth bearing in mind next time you're tempted to use it.
See also Scale AI.

Scale AI operates a platform called Remotask, which hires some 240,000 data labelers in Africa and Southeast Asia at low rates, sometimes less than $1 an hour.[2]

This happens whenever you apply the slightest bit of scrutiny to these people.
 
I saw a YouTube interview with some academics who'd written about AI and they made the point that it's cheaper for Uber to exploit and underpay legions of drivers who buy and maintain their own cars than it would be for them to own and maintain a huge fleet of automated vehicles
 
A recent manifestation seems to be starting up or taking over FB pages about a music style, films, photography and basically getting AI to waffle on about the band/film/photo in question. Eg 'Smith's photo of the dancing girl was taken in Bristol in 1952 .... This photo evokes the nostaligic feelings of joy and being care-free....' etc, etc
Here's a typical one:

'Hole was an American alternative rock band formed in 1989 by Courtney Love and Eric Erlandson in Los Angeles. Known for their raw sound and confrontational lyrics, the band released four albums between 1991 and 2010. Their breakthrough came with Live Through This (1994), blending punk, grunge, and pop rock, followed by the more polished Celebrity Skin (1998). Hole's music often explored themes of gender, body image, and trauma, making them influential in feminist rock. Despite disbanding in 2002, the group reformed briefly in 2010. Hole sold over three million records in the U.S. and earned four Grammy nominations.❤️🎼🎸❤️🎼x 🎸'
 
innovative use of AI here, not sure whether it was actually initiated by Nintendo but could easily be weaponized against people one just doesn't like.


A brave YouTuber has managed to defeat a fake Nintendo lawyer improperly targeting his channel with copyright takedowns that could have seen his entire channel removed if YouTube issued one more strike.

Sharing his story with The Verge, Dominik "Domtendo" Neumayer—a German YouTuber who has broadcasted play-throughs of popular games for 17 years—said that it all started when YouTube removed some videos from his channel that were centered on The Legend of Zelda: Echoes of Wisdom. Those removals came after a pair of complaints were filed under the Digital Millennium Copyright Act (DMCA) and generated two strikes. Everyone on YouTube knows that three strikes mean you're out and off the platform permanently.
Neumayer clearly took a long hard look at the DMCA takedown requests before making any rash decisions about submitting to the claims. That's when he noticed something strange. The requests were signed by "Tatsumi Masaaki, Nintendo Legal Department, Nintendo of America," but the second one curiously "came from a personal account at an encrypted email service: '[email protected],'" The Verge reported.
 
Back
Top Bottom