Showing posts with label technology. Show all posts
Showing posts with label technology. Show all posts

Wednesday, May 07, 2025

AI, The Capitalism Bubble

Socrates ushered in a new age in philosophy.  Academics categorize what came before as "pre-Socratic".  He thought about thinking, argued about arguing, and taught about teaching.  My type of fella.  (Let's acknowledge his exposure to Eastern philosophy as well; nothing human happens in a vacuum.)  Author of a new age, yes; author of any texts at all, no.  Socrates took issue with the written word.

Everything we now know about this person's thoughts come from the writings of his students, and their students.  But to Socrates himself, the written word feels like a trap.  Yes, we can write our words down, but once on the page, they are dead.  Knowledge and wisdom are living things -- practiced, unfinished, and inextricable from the minds which carry and share them.

I don't need to entirely agree (I write, using words) but as I gain some small living wisdom myself, I concede that he has a point, and it's an important one.

Human animals do a lot of neat tricks.  We're perhaps not as novel as we think, but in some ways we're also a bigger deal than we give ourselves credit for.  Let's keep looking at "the written word" but expand the scope a bit to include written music.  Staves, bars, notes, any and all markings on a page you might see in front of a musician.

Even to someone experienced and skilled enough to sight-read any piece of music, there is a difference between interpreting the symbols and hearing the music.  The experience of the sound waves dancing their way across the nerves in our heads is something more rich and more alive than can be adequately captured in written glyphs.  That difference can be staggering -- a lay person may perceive only gibberish of dots and lines on the page, but be moved to tears when hearing a performance of those same notes.

It is a marvelous human trick to translate dormant markings into living music.  When the notes were first scribed, they served as a record, however incomplete, of a human's ideas and experience.  It's shorthand.  It takes practiced work to capture music onto paper, and it takes more practiced work to turn it back into music.  Human minds inject a bit of themselves into each step of the process.  Tuning systems and instrument craft refine over time; what we hear today is not identical to what Bach heard, but nonetheless we get to overlap to a meaningful degree with that specific human experience.

Words in any non-musical language are no different.

The words themselves are indeed dead, but if we take a leap where Socrates refused, we might trust that those who care to read them may breathe life in again.  The original intent may be distorted; it may even become unrecognizable due to translation mistakes or cultural shifts or typos.  Those of us who embrace the written word trust that some future human animal (even simply future versions of ourselves) will be able to either bring what is written alive again, or leave it behind in favor of other thoughts and ideas, which themselves will also ultimately decay and/or find new life.

So, what do poor old Socrates and the potentially-hollow written word have to do with "Artificial Intelligence"?

Large Language Models and various related techniques are what's dominating AI research (also funding) at the moment.  You might have heard these things called "autocorrect on steroids" or "overgrown predictive text" or something to that effect.  Those words feel hollow to AI engineers, but are still fair comparisons.  These models ingest as much written information as the tech companies can collect (steal) and run it through loads of statistical analysis.  Some percent of the time, the word "quite" is followed by the word "often".  Writings which contain the word "Socrates" are more likely to also contain the word "Plato" than "Florida".  Sentences which contain the word "sentence" are sometimes near sentences which are "examples".

A neat parlor trick these programs can do with all those rules about words is to synthesize a coherent-ish conversation.  When a human animal reads the "AI-generated" words (or hears a machine turn text into speech) we do what we always do when we read or hear: we receive and imbue the words with meaning from our own experiences, and breathe life into otherwise-inert material.  It's a convincing trick, because it is tailor-made for a human recipient's brain to assemble the pieces into something real.  After all, the words aren't generated out of thin air, they're made of human writing.  Chopped-up human words, statistically puzzle-piece matched up and Frankensteined back together, ransom-note style.

It's worth noting that this goes well beyond written words.  Different models chop up and rearrange our sounds and images and program code too, among other things.  But it's conceptually the same trick, trained on and working with different data.

It's smoke and mirrors.  We blew the smoke, and we glimpse ourselves in the mirrors.

Which leads nicely to the next point: all of this is computationally expensive.  Ridiculously computationally expensive.  Computers got smaller and faster and cheaper for decades, and they continue to do so, in a manner of speaking.  But in order to simulate a manner of speaking, it takes a whole lot of computers using a whole lot of electricity, sourced principally from a whole lot of burning fossil fuels.  These are incredibly wasteful tricks.  The smoke and mirrors produce a lot of actual smoke.

A rational decision-maker might pause and think, maybe this isn't the best use of those vast amounts of energy.  Maybe our resources ought to be spent making sure we don't kill ourselves off by polluting and altering the climate, here on that one world where we all live.  Maybe we should direct our brightest problem-solving minds toward any of the many pressing problems the planet and its inhabitants are facing.

But that's rational thinking.  Instead, we tech folks imagine a boot so big that we feel compelled to start licking it now.  We pretend that the smoke and mirrors are real thoughts.  A chat bot can pass a standardized test; we might as well entrust it with our life decisions!  We suppose that being good at rearranging words is somehow the same as thinking through plans of action which will have consequences, intended and otherwise.  And we pour all this treasure and energy into what could be the next big thing with the next big profits.  Any other consequence is not worth chasing or even contemplating, apparently.

With 24-hour news cycles, on through social media, and now on through generative content, we've offloaded far too much of our thinking.  We refrain from embracing our own humanity.  Socrates saw the danger right away: the written word truly has gotten us into trouble, letting us shirk our own minds' responsibilities.  It's gone on for so long that human intelligence seems to have fallen out of fashion.

None of this is automatic; everything I've babbled about here is a choice.  Any of us could at any moment turn all this new noise off, and work at rebuilding the living knowledge we've allowed ourselves to lose.  Perhaps ironically, the written word would be one of our best allies in such efforts.

When an interesting question enters my head, I do as many of us do and reach for a search engine.  If it's real knowledge or wisdom I'm after, though, I'm honestly a lot better off if instead I go to a library and do some research the old-fashioned way.  Turning dead words back into human knowledge, without the screens of capitalism running interference, feels novel and refreshing at this point.  Maybe that could catch on.  Much crazier things have happened.

Friday, February 24, 2023

Airquote: "Artificial Intelligence"

ChatGPT and other "deep-learning" programs have made a lot of noise and headlines lately.  As I alluded to in my nopecoin post, I'm very much not on-board with some of the new tricks we're teaching the old dog that is personal computing.

I had the privilege of growing up alongside home computers themselves, as well as the internet.  I remember categorized newsgroups, public web forums, mailing lists, and all sorts of well-thought-out ways for people to connect and share ideas.  So, I've never understood the appeal of this current crop of "social media" giants.  I don't get it.  I so very much don't get it that I don't use any of them.  The closest I come is youtube, which I only touch with a ten-foot pole of browser plugins which disable  the comments, shorts, ads, and most of its other most egregious anti-features.

But, I'm not most people.  Most people go ahead and use facebook/twitter/instagram/whatever, at least to some degree.

Thus, we've let unsupervised and unconsidered algorithms decide which bits of information we see or don't see.  Your facebook/twitter/instagram/whatever feeds are not lists of things you've asked for, they're infinitely-scrolling sets of the items which have been calculated to be the most likely to generate the most profit for the middleman in question.  This has had society-poisoning and democracy-breaking effects, and it should not be surprising that when profits matter more than honesty, things go pear-shaped quickly.

After seeing the messes we get ourselves into when we defer our thinking and sorting to machines (profit machines, specifically), my personal reaction would be to take a step back and reflect, "hm, maybe we need to think this through more carefully".  Instead, we've gone ahead and given these same capitalism bots the ability not to just show and hide and reorder (dis)information, but to literally make things up on the spot.

What?  Why?!

(Well, I know why.  Middlemen need no longer rely solely on their own victicustomers to provide the "content" to shuffle into each others' feeds.)

I'm beginning to feel about AI software the way I feel about guns.  Mechanically, these are fascinating pieces of engineering and ingenuity.  There's both a complexity and a simplicity that is captivating and beautiful.  Also, no thank you!  Decline.  Unsubscribe.  Not in my house.  It claims to be a fun and neutral tool, but I have a very hard time seeing it as anything but a dangerous weapon.

I suspect we'll soon see artificially-generated novels, and movies, and augmented-reality serials.  They'll be amusing enough not to die in the crib.  At nearly no cost, there won't be much reason not to keep trying, even at low points in any fad/zeitgeist cycle.  Entire wikipedias' worth of "information" will come and go and morph and self-refer.  I think that's pretty fascinating, but it also sure looks like authorship, authenticity, and having any basis at all in truth are all up on the chopping block.  Once these things start consuming each others' and their own output as input, we're going to have more messes to clean up than we can deal with.  Based on the current trajectory of our approaches, my guess is we'll try to fight fire with more and more fire.

I worry whether we have much natural intelligence left, let alone what the artificial sort will get up to.

Tuesday, November 29, 2011

Uninterrupted Power Supply, Interrupted

Preface: a UPS is something a guy like me plugs his servers into. Picture a big heavy battery combined with a short power strip. If the lights flicker, stuff plugged into the UPS stays on.

Admittedly, I bought my last UPS in a rush. I don't actually remember doing so, but I must have picked it up somewhere last-resort-y since it has emblazoned upon it the logo of a certain squad of geeks who shall remain unmentioned. So it was definitely not the best ...purchase, I could have made.

But let us ponder a simple question not even of electrical engineering, but of common sense.
When the device eventually fails, should it become:
a) a heavy, non-battery-backed-up power strip
b) a brick through which no electricity passes whatsoever

I'll give you all a few minutes to think about that, a few more if you work for a blue-and-yellow price-gouging store or their branded-Volkswagen-driving subsidiary.

Did you get it? Do you think that a device, whose entire purpose in existing is to provide uninterrupted power, should be designed to fail in such a way that power will still be supplied? If so, good for you! You have the intelligence of a human being. Have a cookie!

If you got it wrong, then no, I don't wish I'd bought your damn extended warranty, so stop asking! The last thing I want at this point is another identical UPS with aspirations of one day growing up to be a brick.

Wednesday, October 17, 2007

Approaching Democracy

I swore this blog wouldn't turn into a political soapbox. I'm breaking that for two reasons: I'm not taking any politically-charged sides here, and it's an idea that's simply too good to go unmentioned.

For as much as we throw around the term "democracy", what we (and all other "democratic" nations) have is a republic. We don't make the decisions; we elect people to make the decisions for us. That's no bad thing necessarily, but that layer of indirection has can be very thick and frustrating at times.

http://senatoronline.com.au/

This is brilliant. It's a hack for an existing republic to inject a bit of direct democracy. All registered voters may vote online on any and every issue that passes through the senate. The senator (human or software) then blindly votes accordingly. If the idea works, clones and variations of the system will also get elected, slowly replacing, to whatever extent citizens are comfortable with, the old republic with a true democracy.

Variations that deal with introducing bills in addition to just voting on them could be very interesting. How to best immunize these systems from party poisoning could become key in how useful and effective they might be in the long term. If nothing else, this conjures a mental image of replacing senators with small shell scripts, which should bring a huge smile to any geek's face.