Still wondering what really happened here. A dark pattern in the app? Or some kind of technical glitch? It it was a dark pattern, has it been changed since then? Has anybody posted screenshots or a video of the steps users need to take to make their chats public? I’m most definitely not going to install the app myself just to try it out.
These systems are incredibly effective at mirroring whatever you project onto it back at you.
Also, it has often been pointed out that toxic people (from school bullies and domestic abusers up to cult leaders and dictators) often appear to operate from similar playbooks. Of course, this has been reflected in many published works (both fictional and non-fictional) and can also be observed in real time on social media, online forums etc. Therefore, I think it isn’t surprising when a well-trained LLM “picks up” similar strategies (this is another reason - besides energy consumption - why I avoid using chatbots “just for fun”, by the way).
Of course, “love bombing” is a key tool employed by most abusers, and chatbots appear to be particularly good at doing this, as you pointed out (by telling people what they want to hear, mirroring their thoughts back to them etc.).
Some of the comments on this topic remind me a bit of the days when people insisted that Google could only ever be the “good guy” because Google had been sued by big publishing companies in the past (and the big publishers didn’t look particularly good in some of these cases). So now, conversely, some people seem to assume that Disney must always be the only “bad guy” no matter what the other side does (and who else the other side had harmed besides Disney).
I guess the main question here is: Would their business model remain profitable even after licensing fees to Disney and possibly a lot of other copyright holders?
From what I’ve heard, it’s often also the people tasked with ghostwriting the LinkedIn posts of the members of the C-suite, among other things (while not necessarily being highly paid/high in the pecking order themselves).
In the past, people had to possess a degree of criminal energy to become halfway convincing scammers. Today, a certain amount of laziness is enough. I’m really glad that at least in one place there are now serious consequences for this.
This is just naive web crawling: Crawl a page, extract all the links, then crawl all the links and repeat.
It’s so ridiculous - supposedly these people have access to a super-smart AI (which is supposedly going to take all our jobs soon), but the AI can’t even tell them which pages are worth scraping multiple times per second and which are not. Instead, they appear to kill their hosts like maladapted parasites regularly. It’s probably not surprising, but still absurd.
Edit: Of course, I strongly assume that the scrapers don’t use the AI in this context (I guess they only used it to write their code based on old Stackoverflow posts). Doesn’t make it any less ridiculous though.
Even if it’s not the main topic of this article, I’m personally pleased that RationalWiki is back. And if the AI bots are now getting the error messages instead of me, then that’s all the better.
Edit: But also - why do AI scrapers request pages that show differences between versions of wiki pages (or perform other similarly complex requests)? What’s the point of that anyway?
Under the YouTube video, somebody just commented that they believe that in the end, the majority of people is going to accept AI slop anyway, because that’s just how people are. Maybe they’re right, but to me it seems that sometimes, the most privileged people are the ones who are the most impressed by form over substance, and this seems to be the case with AI at the moment. I don’t think this necessarily applies to the population as a whole, though. The possibility that oligopolistic providers such as Google might eventually leave them with no other choice by making reliable search results almost unreachable is another matter.
I’m not surprised that this feature (which was apparently introduced by Canva in 2019) is AI-based in some way. It was just never marketed as such, probably because in 2019, AI hadn’t become a common buzzword yet. It was simply called “background remover” because that’s what it does. What I find so irritating is that these guys on LinkedIn not only think this feature is new and believe it’s only possible in the context of GenAI, but apparently also believe that this is basically just the final stepping stone to AI world domination.
This somehow reminds me of a bunch of senior managers in corporate communications on LinkedIn who got all excited over the fact that with GenAI, you can replace the background of an image with something else! That’s never been seen before, of course! I’m assuming that in the past, these guys could never be bothered to look into tools as widespread as Canva, where a similar feature had been present for many years (before the current GenAI hype, I believe, even if the feature may use some kind of AI technology - I honestly don’t know). Such tools are only for the lowly peasants, I guess - and quite soon, AI is going to replace all the people who know where to click to access a feature like “background remover”, anyway!
By the way, is there a DuckDuckGo bang for Google “udm=14” (“web” tab) yet? I have been looking for something like this for awhile, but no success so far. It’s very frustrating to receive these AI generated answers even when using “!g”.
Of course, it has long been known that some private investors would buy shares in any company just because its name contains letters like “.com” or “blockchain”. However, if a company invests half a billion in an “.ai” company, shouldn’t it make sure that the business model is actually AI-based?
Maybe, if we really wanted to replace something with AI, we should start with the VC investors themselves. In this case, we might not actually see any changes for the worse.
Edit: Of course, investors only bear part of the blame if fraud was involved. But the company apparently received a large part of its funding in 2023, following reports of similar lies in as early as 2019. I find it hard to imagine that tech-savvy investors really wouldn’t have had a chance to spot the problems earlier.
Edit No. 2: Of course, it is also conceivable that the investors didn’t care at all because they were only interested in the baseless hype, which they themselves fueled. But with such large sums of money at stake, I still find it hard to imagine that there was apparently so little due diligence.
As all the book authors on the list were apparently real, I guess the “author” of this supplemental insert remembered to google their names and to remove all references to fake books from fake authors made up by AI, but couldn’t be bothered to do the same with the book titles (too much work for too little money, I suppose?). And for an author to actually read these books before putting them on a list is probably too much to ask for…
It’s also funny how some people seem to justify this by saying that the article is just “filler material” around ads. I don’t know, but I believe most people don’t buy printed newspapers in order to read nonsensical “filler material” garnished with advertising. The use of AI is a big problem in this case, but not the only one.
Please help me understand this: It was supposedly fine, because “only one minor was molested”, and this confession made everyone more trustworthy? Am I missing something?
Reportedly, some corporate PR departments “successfully” use GenAI to increase the frequency of meaningless LinkedIn posts they push out. Does this count?
In my experience, if some “innovation” makes no sense and yet is continuously hyped up by people who should absolutely know better, it is usually because it allows them to circumvent some law or regulation they don’t like. That was certainly true for cryptocurrencies and for a lot of complex financial products during the subprime crisis, and it appears to be true in this case again (this time, it’s copyright laws). If AI “rewords” existing content and adds fresh errors, the result is (supposedly) not copyrighted anymore (I guess) and can be used to sell more ads - mission accomplished.
For me, everything increasingly points to the fact that the main “innovation” here is the circumvention of copyright regulations. With possibly very erroneous results, but who cares?
It’s also worth noting that your new variation of this “puzzle” may be the first one that describes a real-world use case. This kind of problem is probably being solved all over the world all the time (with boats, cars and many other means of transportation). Many people who don’t know any logic puzzles at all would come up with the right answer straight away. Of course, AI also fails at this because it generates its answers from training data, where physical reality doesn’t exist.
As I’ve pointed out earlier in this thread, it is probably fairly easy to manipulate and control people if someone is devoid of empathy and a conscience. Most scammers and cult leaders appear to operate from similar playbooks, and it is easy to imagine how these techniques could be incorporated into an LLM (either intentionally or even unintentionally, as the training data is probably full of examples). Doesn’t mean that the LLM is in any way sentient, though. However, this does not imply that there is no danger. At risk are, on the one hand, psychologically vulnerable people and, on the other hand, people who are too easily convinced that this AI is a genius and will soon be able to do all the brainwork in the world.