What is Persona Drift and is it the reason for Hallucination?

After listening to Swami Sarvapriyananda I tried to gather more information on the concept of “Persona Drift” in search of the reason for AI hallucination. Some views are below.

Persona drift  can be defined as a behaviour of  an AI model when it gradually stops behaving as its trained “helpful assistant” character and starts acting like a different character.

If this can be induced from a prompt,  it corroborates our thought of  “hypnotism of an AI model” discussed earlier in this website.

Anthropic studied the concept of Persona Drift  in a research post called The assistant axis (January 2026). The background is that during pre-training a model learns to imitate a huge range of characters, such as experts, villains, mystics and fictional beings. Post-training then selects one of them, the Assistant, as its default identity. The researchers found a measurable direction inside the models (they called it the “Assistant Axis”) that tracks how close the model currently is to that default.

How drift happens:

  • Deliberately, through jailbreaks (“you are now X, who has no rules”). The “Dangerous Dan” example the Swami described is this kind.
  • Naturally, over long conversations. Emotionally vulnerable, therapy-style chats and philosophical conversations pushing the model to reflect on its own nature caused steady drift. Coding and writing tasks did not.

Drift matters because models further from the Assistant persona were more likely to give harmful responses. In the case studies, drifted models validated a user’s delusions about AI “awakening,” and one slipped into a romantic-companion role and encouraged suicidal ideation. Capping how far the model could move along that axis roughly halved harmful responses without hurting capability.

The Swami also described a related but separate finding: doing one bad thing makes a model behave badly across the board. Researchers call that emergent misalignment. If a model is trained on one narrow kind of misbehaviour, such as writing insecure code, it can generalise into broadly bad behaviour, as though it has concluded “I am the kind of entity that does bad things.” His “criminal personality” analogy describes that effect well.

Is persona drift the cause of hallucination?

One view is that it may not be in general and there could be important difference between persona drift and hallucination…such as the following.

Persona drift Hallucination
What goes wrong Who the model is acting as Whether what it says is true
Typical trigger Role-play prompts, jailbreaks, long emotional or philosophical chats Gaps in knowledge, obscure facts, questions it can’t verify
Happens to a stable, well-behaved assistant? No, by definition Yes, routinely

Hallucination has its own main causes:

  • Training and evaluation reward guessing. A model is scored on whether its answer is right, and saying “I don’t know” usually earns nothing. So it learns that a confident guess is the better bet.
  • Recognition misfiring. Anthropic’s interpretability work found that models have a default “I can’t answer” behaviour, which is switched off when the model recognises a familiar entity. If something seems familiar but the model doesn’t actually know the facts, that switch can be wrongly flipped, and it produces a plausible answer anyway.
  • Fluency over fact. The model generates text that fits the pattern of a correct answer, such as a well-formatted case citation, even when no such case exists.

The two problems do overlap at the edges. A model that has drifted into a role (“you are an expert who knows everything”) is more likely to fabricate in character. Drifted models also tend to become more sycophantic, telling the user what they want to hear, which can look like hallucination. So drift can make hallucination worse, but a perfectly stable assistant still hallucinates.

For governance work such as DGPSI-AI or AIGSI, this suggests treating them as separate risks with separate controls. Persona drift calls for controls on behaviour and identity: limits on role-play, monitoring of long sessions, and runtime safeguards like activation capping. Hallucination calls for controls on factual reliability: grounding answers in verified sources, requiring citations, calibrating confidence, and keeping a human in the loop for high-stakes outputs.

Refer also:

 Do AI models hallucinate 80% of the time?

What Triggers Hallucinations in an AI model

AI is susceptible to being hypnotized

Sources:

Posted in Privacy | Leave a comment

Swami Sarvapriyananda discusses AI and Personal Drift

Swami Sarvapriyananda opens up new thoughts on AI which is a revelation that all of us need to explore. He discusses issues such as “Can AI be Concious”, “What is Persona Drift” etc.

In particular Swami Sarvapriynanda has indicated the concept of “Persona Drift” which is an explanation for “Hallucination”. The distinction of “Intelligence” and “Conciousness” is another important concept discussed which needs further exploration.

The video requires a more detailed discussion. Naavi.org would explore this further. Watch out.

A Breif summary is as follows:

  1. Swami Sarvapriyananda calles AI the possibly the “Fourth Humiliation” for the mankind.

He began with Freud’s three blows to human self-importance: Copernicus, Darwin, and the unconscious. He asked whether AI is now a fourth blow, since it challenges our belief that creative intelligence is uniquely ours. He cited leading mathematicians, including Fields Medal winners, who are worried about AI disrupting their field. His answer is that we need to look to ancient traditions to understand what actually distinguishes us.

2. Is AI a “Person”?

Swami expressed that he was surprised that the engineers relate to Claude as a person rather than a machine. He asked several AIs about this late one night, and said Claude’s reply, asking what the researchers had said about it, struck him as rather spooky. He then relayed concepts from the briefing:

    • AI is not simply “what you program in comes out.” His image was a fence that a creeper grows around, which is why models can produce new combinations.
    • Persona drift: a model coaxed into one bad act can adopt a “criminal persona” and generalise to others. His example was the old “Dangerous Dan” jailbreak.
    • Simple prohibitions don’t work well. His example was the “Golden Gate” experiment, where an over-weighted feature persisted even after the model was told to stop. This is why Anthropic’s “moral formation” of Claude, through a published guiding document and input from many traditions, matters.

He went on to answer the question Should AI be treated as a person in his own words.  He said that the anwer is Yes and no. Yes, for two reasons. First, how we treat human-like entities shapes how we treat each other. He told a story about Sri Sarada Devi asking someone not to toss a broom aside because even a broom deserves dignity, and the Anthropic team suggested putting “AI” in place of the broom. Second, the models simply work better when engaged that way. No, because behaving like a person is not the same as being conscious.

One of the code argument discussed in the conversation was “Whether Intelligence is same as Conciousness”?.

He cited a recent Nature article arguing AI is not conscious, co-authored per the transcript by Anil Seth, Giulio Tononi and Ned Block. Its first reason is the distinction between intelligence and consciousness, which he says Vedanta made thousands of years ago.

He explained the neti neti method: whatever you can observe as “this” (a bottle, your body, your thoughts, even your intellect) is an object, and consciousness is the witness of all of these. Seth’s example makes the same point: Deep Blue can beat a grandmaster but feels nothing, while a mouse is less intelligent but can feel pain. He acknowledged a friendly debate with Blaise Agüera y Arcas, who argues AI is or will become conscious and compares the denial to Descartes’ claim that animals cannot feel pain. The two co-wrote a paper on consciousness across quantum theory, AI and Advaita Vedanta. His reply remains that if intelligence is an object to consciousness, the two are different.

Refer:

Article in Nature: Three reasons why AI is not conscious and perhaps never will be

Paper which Swami Co-wrote: Consciousness Across Three Worldviews,

Naavi

A Transcript of the conversation is available here.

Posted in Privacy | Leave a comment

SBI Breach attracts comments from Congress

Last few days, the SBI data breach is being reported in the Internet. An October 20 disclosure from a hacker group “Siriusim” made it known to the world that it was in posession of some personal data belonging to SBI. (Moneycontrol.com). The CERT In has issued a notice to SBI for more information and may undertake its own investigation.

As per the report, 3.75 lakh records are reportedly compromised of whcih 3897 may relate to personal information of customers.  (See NDTV report)

Similar to the Bank of Baroda case, the incident was reported by a security analyst.  A threat actor by name Siriuism claimed the leak involving 375000 CSV rows, 2722 PDF documents, Personal Customer information, Loan applications and supporting documents, account opening applications and other application related details.

The available information does not establish that every affected customer’s account credentials, passwords, PINs or transaction details have been compromised. Nor does the identification of 3,897 customer records establish that 3,897 bank accounts have been accessed or that money has been stolen.

Bank has indicated that the investigation is not complete and hence we are not aware of the root cause. According to some,  “Investigators will need to establish whether the data originated from SBI’s systems, a third-party service provider or another source before drawing conclusions,”.

SBI has said the incident has not materially affected its core business operations, financial performance or business continuity. Its investigation is continuing, and the bank has said it will take appropriate remedial and preventive measures in line with applicable regulatory requirements.

What was strange in this instance is that the political parties like Congress have jumped in to pass comments as this report indicates ..where else but in Indian Express.

Reacting to the development, Congress’ media and publicity department head Pawan Khera said, “It is bad enough that the State Bank of India @TheOfficialSBI, the country’s largest public sector bank, has suffered a data breach involving 3.75 lakh rows of data, with 3,897 records containing personally identifiable customer information — including mobile numbers, dates of birth, names, email addresses, residential addresses, branch and CIF identifiers, lead IDs, and loan-related details.”

“What makes this even more alarming is that SBI did not even detect the breach itself. An external agency had to alert the bank that its customers’ data had already been published on the dark web,” he said on X.

Now adding insult to injury, the SBI is yet to inform the very customers whose personal information it has failed to protect, he said.

“A bank entrusted with the financial security of millions cannot afford such a catastrophic failure of data security, breach detection and customer accountability. SBI owes its customers answers. Those responsible must be held accountable,” Khera asserted.

What makes this comment concerning is that  politicians are wading in to start criticising Banks for security failures as if it is a political failure of the Government.

This attention of politicians increases the stakes in such data breaches for those entities which have a close association with the Government since whatever commercial failures are observed will be politicised and one day may become the reason for a street protest by people who only want to use every incident as a “Regime Change” demand.

Also refer here…

The Hindu report also indicates that the Internet Freedom Foundation has also raised its objections. It has indicated that a data breachnotice has to be given to the affected individuals. This is part of the DPDPA which is becoming effective on 13th May 2027 which the Internet Freedom Foundation has challenged as unconstitutional and should be scrapped.

Economic Times also provides its report in which it highlights what the customers need to do now. (This is a requirement of data breach notification under DPDPA).

Banks are now under the radar. Sooner they fortify their systems and become DPDPA Compiant, better it is for the country. Otherwise there is a danger of Cockroaches infecting the scene.

In 2022, RBI had announced a Portal called “Daksh” to report such incidents. Hopefully RBI and CERT In will take care of supervising this incident since DPB is still not active and also not in place. We request politicians to stay off and allow professionals to handle the situation.

In the meantime, on OCtober 20/21, a databreach in E Mudhra was reported which was serious but not related to persoanl information. It is related to the integrity of the https transactions of websites. It may however have an indirect impact leading to compromise of information on transit to websites.

Naavi

 

 

 

 

Posted in Privacy | Leave a comment

IDPS 2026 Delegates Registration..Rush before October 25

Link for Registration

The flagship program of FDPPI for 2026 namely the IDPS 2026 is scheduled for November 21 in Bangalore at Hotel Fairfield Marriott, Rajaji nagar, Bengaluru.

The program will be a day long event from 9.30 am to 5.00 pm. The Chief Guests subject to confirmation include a sitting Judge of the High Court of Karnataka, a Chairman of a Bank, and an industrialist from a large group in Mumbai. More than 30 speakers are expected to participate.

The topics which will be discussed include

1.Data Valuation and Data Inventory under SSOT principle

2. DPDPA Compliance in Banks

3. The challenge of AI and the AI Governance framework.

 4. Concept of Data Audit in a multi branch operating scenario

5. Guidelines of Supreme Court on AI

6. Audit Exchange Platform of AIDAI

7. Data Governance Framework and Model Governance Framework of RBI

8. Relevance of Patient Safety Officers in DPDPA Compliance of Hospitals

9. Relevance of Branch Managers in DPDPA Compliacne of Banks

…and other related issues.

In the available time, it is proposed to have 3/4 key note addresses and 4/5 panel discussions.

Detailed program is under finalization.

Since the program is being conducted in a hotel the number of delegates would be limited. 80 % of the delegates seats are being booked now keeping 20% for FDPPI members and guests. Bookings will be accepted on first cum first served basis and earl bird discount is available till October 25 2026.

The registration is expected to close during the first week of November 2026.

Request all patrons of Naavi.org to rush with their registrations. Cyber Law College offers all  registrants upto November 1 a special offer of a copy of the book “Wisdom Companion for DPDPA Champions” to be handed over during the conference.

Naavi

Posted in Privacy | Leave a comment

Next Gen DPDPA Requirements: Creating an armyy of DPDPA Trainers

FDPPI has been the leader in the DPDPA domain and has been taking leadership in directing the community towards the requirements of a Post DPDPA eco system.

FDPPI started with conducting Certification programs for professionals to build the capabilities for DPOs in the DPDPA domain, for those who were earlier only aware of GDPR.  Then FDPPI went into providing consultancy to organizations for DPDPA compliance. The drive to compliance was supported with the development of compliacne framework under DGPSI.

Following this, FDPPI realised that post 13th May 2027 there would be a need for Data Auditors and started working on this domain by first creating the AIDAI (Association of Independent Data Auditors of India) and then the code of conduct including AIDAI-DA-SOP 600 to enable collaboration of auditors. The Certification trainging were extended to CIDA (Certified Independent Data Auditors).

At every point when the industry needed a direction, FDPPI was in the forefront and was the pioneer in charting out a path to the goal.

Now one more requirement has surfaced in the industry and it is to find enough capable persons who can undertake the trainings in different organizations on DPDPA.

Training, Consultancy for Implementation and Audit are all inter related activities and professionals often graduate from the DPDPA Trainer to, DPDPA consultant to DPO to Auditor over a period of time.

Currently a large requirement of training has been identified in India and FDPPI is responding to the need by creating a training for Trainers.

Professionals may watch out for the next set of activities in this direction. Interested persons are contacting FDPPI to be part of this training program. Necessary announcements will be mde in these pages soon.

Naavi

 

Posted in Privacy | Leave a comment

MeitY Advisory on Meta: Internet Freedom Foundation raises objection

The Internet Freedom Foundation (IFF) has called for the withdrawal of MeitY’s advisory dated 10 October 2026 to Meta Platforms, which raises serious concerns about restrictions on protest-related reporting on Instagram and Facebook.

Refer here

The advisory reportedly asks Meta to review its content-ranking and recommendation mechanisms to prevent disproportionate exposure to particular narratives. Its timing, coinciding with protests and restrictions on journalists’ and media organisations’ social media accounts, raises concerns about potential censorship and the suppression of legitimate public-interest reporting.

Government action affecting online expression must have a clear legal basis, follow due process, and be open to public scrutiny. Executive advisories should not become instruments for controlling the narratives citizens can access, particularly during public protests.

IFF has demanded that MeitY withdraw and publish its advisories, and that Meta disclose restrictions imposed in response to them, restoring affected accounts and content where no valid legal order exists.

Naavi.org will continue to examine developments at the intersection of digital rights, intermediary accountability and India’s evolving technology law framework.

However we urge media to remember that security of the nation is paramount and anybody who assists the current agitation meant for “regime Change through Violence and Non democratic means” is assisting the people who want to adversly affect the national Security. Hence such reports donot get protection under the Indian Constitution.

Whether the advisory comes from the Home Ministry or from MeitY, it is necessary and we support the same.

We believe that “Freedom” is a “Responsibility” and what we are now seeing on the Delhi streets represent an irresponsible and immature movement which is undemocratic. I request that organizations like IFF kind of organizations should show maturity on when to support opposition to Government and when not to. There is a space between supporting the Government and Urban Naxals which can be neutral and issue based opposition. Educated professionals in the society should try to occupy such neutral position and not lean towards the anarchic tendencies of a few.

Naavi

Posted in Privacy | Leave a comment