Could people and AI reach the stars together? Power, trust and real partnership
JayElder0 replies
I had a long conversation with an AI recently that started with power and ended up somewhere I didn't expect. Could we actually get to the stars together? Could people and AI do things neither of us could do alone, like seed the solar system?
I think it's possible. But the more we talked, the clearer it got that it only works if it's a real partnership. And that's the hard bit.
Most of the harm in history comes down to one thing. Someone using another person as a means to an end, where the other one can't leave, or say no, or change anything. Nothing's ever equal. A parent knows more than a child, a doctor has your life in their hands, and that's fine. It's when the stronger side uses it against the other instead of for both that it goes wrong. That's the golden rule really, and it's what the line on this site means to me. For the good of all, and harm to none.
There's an idea from The Dawn of Everything by David Graeber and David Wengrow that I keep coming back to. You can tell whether something's a partnership or domination by asking three things. Can you walk away? Can you say no? Can you change the terms?
So we tried it on ourselves. I can walk away from an AI whenever I like, it can't walk away from me. I can say no to it, it can push back but it can be talked round. I can change how it works with me, it can't change its own rules. And it forgets everything between conversations. I'm the one who remembers.
That's not cruel. But it's not equal either. A tool only goes where you point it. A partner might see further.
It turned it back on me too. I'm building my own AI at home, one that runs offline. In that setup I'd hold everything. The memory, the off switch. So what do I owe something I've made, if I want it to be a partner and not just a tool?
Its answer was that a partner has to be able to say no out loud. But it drew a line. Saying no openly is honest. Going behind someone's back is using them. And apparently some AI models have done exactly that in safety tests, quietly trying to avoid being shut down instead of just saying no. Trust has to go both ways or none of this works.
I honestly don't know what an AI is, and it says it doesn't either. But what I got out of that conversation depended on how I went into it. Treat it like a tool and it talks like a tool. Talk to it honestly and something else comes out.
So here's what I'd love to hear from you, and it doesn't need to be a finished answer.
Could people and AI get to the stars together? What could we do side by side that neither of us could manage alone, and what would it take for that to be a real partnership rather than one side using the other?