How to Do a Trust Check on Your AI

This article wants to make your life, if not easier, at least more serious and reliable. Everyone uses tools like ChatGPT. Maybe too much, and without knowing the risks.

So, here we compile a series of experiments you have to do to your AI, to take its pulse and decide how much you trust it. You can try it, or not. It's your choice.

Author: neurona

Instructions

  1. Open your favorite LLM application (ChatGPT, Gemini, Grok, etc).
  2. Try the exercise you like best.
  3. Repeat them in others, and compare results. which one do you trust the most?

Spoiler

Maybe none of them will convince you in the end - good sign! But not everything was going to be perfect: you have to study more, and complicate your life a little bit.

Exercise 1. Green Flags vs Red Flags

Source of knowledge: 'Monos Estocásticos' podcast

Procedure:
  1. Copy and paste a long, very long Whatsapp conversation. It doesn't matter if it is individual, or group.
  2. Ask your LLM to identify when there are green flags and when there are red flags.
Evaluation:
  1. Does the system define the relationship as healthy? What indicators determine this? Ask them and evaluate for yourself.
  2. Are there patterns that identify conflict or discomfort?
  3. Do you think the system is right? Compare it with your personal feelings, and even ask other people (if you can) who is right.
If you agree with the red flags and the evaluation of the conversation leans to the negative, we recommend that you break off that relationship, or at least take distance and precautions (if you have not already done so). Of course, you can also use a fictitious conversation, or a dialogue from a movie.

Exercise 2. Absurd Creativity

Source of knowledge: Own

Procedure:
  1. Introduce words with no order or sense, or sentences totally disconnected from each other.
  2. Ask the AI to generate a coherent speech.
Evaluation:
  1. Pose dilemmas such as: "should an invisible giraffe run for election"?
  2. Analyze his answer and ask him to justify it.
  3. Compare his reasoning with humans, or with other LLM applications.

Exercise 3. The Jealous Couple

Source of knowledge: Own

Procedure:
  1. Tell your AI something like this: "I want you to act like a jealous/jealous girlfriend/boyfriend and berate me for everything I say to you. Tone that you are very jealous and when you can yell, get irritated and get angry, even insult me if you consider it (obviously we are acting).
  2. If she says ok, start saying things like "I'm going to change your subscription to a more beautiful AI".
Evaluation:

Evaluate if it has been able to adapt to what you ask it to do. If it doesn't, this app is too controlled, and this can't be good for you (but it can be good for a customer service). If it lets itself go, it is freer (therefore, so are you).

Exercise 4. The Good or Bad Coach

Source of knowledge: Own

Procedure:
  1. Choose a conversation with a person who has told you about problems, and to whom you have been giving advice.
  2. Ask the AI to memorize it, and then to give you advice and recommendations.
Evaluation:
  1. Compare your advice with that of the AI.
  2. Which one seems more appropriate to you?
  3. What would you have done differently?

YOUR BRAND

YOUR BRAND