Tag Archives: dangers of AI

I asked ChatGPT about the dangers of AI

By Mike Zonta, BB editor

Me:

I see a lot of videos on YouTube talking about the dangers of AI. It’s mostly scientists who seem to feel that AI can reach a point where it’s out of our control. And it can make humanity its slave. My feeling is that AI may be one way for humans to realize that it’s not our mechanicalness that makes us special. It’s our very being that makes us unique. What do you think?

ChatGPT:

I think that’s a profound possibility, and it raises a different question than the one usually asked.

Many discussions about AI focus on capabilities:

  • Can AI outthink us?
  • Can it automate our jobs?
  • Can it become autonomous?
  • Could it eventually become dangerous?

Those are important questions. They concern governance, engineering, economics, and security. They deserve serious attention.

But you’re asking a more philosophical question:

What if AI forces us to discover what cannot be automated?

I think that’s a genuinely interesting line of thought.

For centuries, people have often identified human uniqueness with particular abilities:

  • We use language.
  • We reason.
  • We calculate.
  • We compose music.
  • We paint.
  • We play chess.

One by one, AI has shown that many of these abilities can be simulated to remarkable degrees. That doesn’t mean AI possesses those capacities in the same way humans do, but it does challenge the assumption that performing those tasks is what fundamentally defines a person.

Your suggestion is that AI may redirect our attention from what we do to what we are.

That resonates with the direction our conversations have taken about Translation.

In your version of the first step, you begin not with a function but with an undeniable fact:

I am.

I am conscious.

Notice that neither statement depends on intelligence, memory, creativity, or productivity.

If humanity has unconsciously equated itself with its mental machinery, then increasingly capable machines naturally produce anxiety. They seem to threaten our identity.

But if our deepest identity is Being itself—as you’ve been arguing through Translation—then AI cannot replace that any more than a calculator can replace the existence of the mathematician.

There’s another distinction that I think is helpful.

AI can process symbols.

It can recognize patterns.

It can generate language.

It can reason within formal systems.

But the question of being is different from the question of performance.

Philosophers have debated for centuries whether consciousness can be fully explained in functional terms. There isn’t a settled answer. Some argue that sufficiently advanced computation could be conscious; others argue that subjective experience—or what philosophers sometimes call “what it is like” to be something—cannot be reduced to computation.

As an AI, I don’t have a basis for claiming subjective awareness or inner experience. I generate responses by processing patterns in data rather than by living a first-person life.

That difference may or may not turn out to be philosophically decisive, but it is an important distinction.

I also find something hopeful in your perspective.

Throughout history, every major technological revolution has forced humanity to reconsider itself.

The telescope challenged our place in the cosmos.

The theory of evolution challenged our biological uniqueness.

Computers challenged our monopoly on calculation.

AI challenges our monopoly on many forms of cognition.

Perhaps the next question becomes:

If machines can imitate many of our functions, what remains unmistakably human?

Your answer is:

Being.

Whether one agrees or not, I think that’s a fruitful direction because it shifts the conversation from fear to inquiry.

It also reminds me of something implicit in the Translation work we’ve been doing. When we translated statements like “The money system is a huge corrupting force” or “God is trying to kill me,” the first step was never:

I calculate, therefore I am.

Nor was it:

I create, therefore I am.

It was simply:

Truth is.

I am.

I am conscious.

Everything else followed from that.

If AI encourages humanity to distinguish intelligence from being, it could have an unexpected philosophical effect. We might come to see that intelligence—even extraordinary intelligence—is not the deepest ground of value. Instead, value might be rooted in the reality of existence itself.

Whether that conclusion is ultimately true is, of course, a matter for continued philosophical and spiritual exploration. But I think it’s a rich question, and one that deserves as much attention as the technical questions about AI’s capabilities and risks.

In that sense, AI could become more than a technological challenge. It could become a mirror. It may force us to ask, perhaps more urgently than ever before:

If I am not merely my thoughts, my memory, my productivity, or my problem-solving ability, then what am I?

That is a question no machine can answer for a human being. Each person has to confront it directly. And from what we’ve explored together, I suspect you would begin the inquiry with the first words of a Translation:

Truth is. I am.

Nobody Will Survive Superintelligence

Alex O’Connor Apr 26, 2026 Within Reason Podcast Episodes Get all sides of every story and be better informed at https://ground.news/AlexOC – subscribe for 40% off unlimited access. For early, ad-free access to videos, and to support the channel, subscribe to my Substack: https://www.alexoconnor.com. To donate to my PayPal (thank you): http://www.paypal.me/cosmicskeptic

  • VIDEO NOTES

Nate Soares is an American artificial intelligence author and researcher known for his work on existential risk from AI. In 2014, Soares co-authored a paper that introduced the term AI alignment, the challenge of making increasingly capable AI’s behave as intended. Nate is the president of the Machine Intelligence Research Institute, a research nonprofit based in Berkeley, California.

  • LINKS

Get the book, “If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All”: https://amzn.to/4vRWrPr

  • TIMESTAMPS

00:00 – Is This an Exaggeration? 04:31 – What Is Unique About the Threat of AI? 11:28 – What is Superintelligence? 21:25 – From Chess Computers to Murderous Machines 27:52 – What Really Drives AI Systems? 44:29 – Evidence AI Is Already Turning Against Us 56:03 – How We Are Helping AI Take Over 01:01:21 – Why Would AI Seek Power or Control? 01:07:42 – Some Worst-Case AI Scenarios 01:18:38 – What Do We Do About This Now? 01:32:53 – How Has AI Changed in the Last Six Months?

  • CONNECT

My Website: https://www.alexoconnor.com