REGULATING AI-GENERATED DEEPFAKES IN INDIA’S SECURITIES MARKET: A CRITICAL ANALYSIS OF SEBI’S ROLE AND POLICY IMPLICATION

Authors

  • Ansuman Barik Christ Deemed to be University, Bangalore

Keywords:

Artificial Intelligence, Deepfakes, Investor Protection, SEBI Regulation, Cyber Fraud in Capital Markets

Abstract

The rapid growth in artificial intelligence (AI), particularly the deep learning technologies, has significantly transformed India’s securities market. It offers a unique set of tools that assist investors and other intermediaries in financial analysis. However, there is a rise in misuse of AI-generated deep-fakes and misinformation that impersonate corporate leaders, regulators and financial experts, misleading the retail investors, manipulating the stock prices and undermining market confidence. This paper argues that the Securities Exchange Board of India (SEBI) needs to extend its regulatory oversight beyond the registered entities' activity to encompass all forms of AI-driven financial misinformation, including deepfakes. Relying on real-world incidents across India and globally, the paper demonstrates how deepfakes or AI- generated misinformation (particularly in the securities market) have led to losses to investors and market volatility. Although jurisdictional limits, regulatory overlap with the Ministry of Electronics and Information Technology (MeitY), and free speech concerns pose challenges, the paper contends that through effective collaboration, coordinated frameworks, investor education, targeted regulation under the PFUTP Regulations and technological collaboration with the AI research entities, SEBI can effectively address these concerns. Additionally, comparative analysis from the UAE FSRA, UK FCA, US SEC and FINRA and Germany’s BaFin practices further inform a robust policy proposal. Finally, the study looks into SEBI’s proactive intervention, along with balanced inter-agency cooperation, is required to protect
the interests of the investors and market integrity in the era of AI.

References

Shannon Bond, ‘Fake viral images of an explosion at the Pentagon were probably created by AI’ (NPR,

May 2023) <https://www.npr.org/2023/05/22/1177590231/fake-viral-images-of-an-explosion-at-the-pentagon-were-probably-created-by-ai> accessed 19 October 2025.

Islam Dogru, ‘Fake image of Pentagon blast sparks US stock market panic’ (Anadolu Agency, 24 May

<https://www.aa.com.tr/en/fact-check/fake-image-of-pentagon-blast-sparks-us-stock-market-panic/2904718> accessed 19 October 2025.

Nidhi Thakur, ‘AI in Online Trading – How Artificial Intelligence is Changing Stock Markets’(Swastika Investmart Ltd Blog, 9 September 2025) <https://www.swastika.co.in/blog/ai-in-online-trading---how-artificial-intelligence-is-changing-stock-markets> accessed 19 October 2025.

Ibid

Emett S, Eulerich M, Pickerd J and Wood DA, 'Short and Synthetically Distort: Investor Reactions to Deepfake Financial News' (June 2024) SSRN 4869830 <https://ssrn.com/abstract=4869830 > accessed 24 October 2025

Boston Institute of Analytics, ‘The Rise of Finfluencers: How Social Media Is Reshaping Investment Decisions in 2025’ (Boston Institute of Analytics, 3 May 2025)<https://bostoninstituteofanalytics.org/blog/the-rise-of-finfluencers-how-social-media-is-reshaping-

investment-decisions-in-2025/ > accessed 23 October 2025

Purvi Nema, ‘Understanding Copyright Issues Entailing Deepfakes in India’ (2021) 29 International Journal of Law and Information Technology 241, <doi:https://doi.org/10.1093/ijlit/eaab007 >(Advance Access Publication Date: 25 October 2021).

Neill Jacobson, ‘Deepfakes and Their Impact on Society’ (CPI OpenFox Blog, 26 February 2024) <https://www.openfox.com/deepfakes-and-their-impact-on-society/> accessed 19 October 2025.

Priyanshi Oza, Nirjharaa Patel and Ayushi Patel, ‘Deepfake Technology: Overview and Emerging Trends in Social Media’ (2024) Department of Computer Science and Engineering, P P Savani University.

Sushant Kulkarni,‘Deepfake video of stock market expert used for online share trading fraud’ (Indian Express, 17 October 2023) <https://indianexpress.com/article/cities/pune/deepfake-video-stock-market-expert-online-share-trading-fraud-9662608/> accessed 19 October 2025.

TNN / Updated: Apr 11 2024, ‘NSE Flags “deepfake” Video of MD Sharing Stock Tips - Times of India’ (The Times of India) <https://timesofindia.indiatimes.com/business/india-business/nse-flags-deepfake-video-of-md-sharing-stock-tips/articleshow/109208724.cms > accessed 19 October 2025

Library of Congress, The Spanish-American War in Motion Pictures: About This Collection (1998) <https://www.loc.gov/collections/spanish-american-war-in-motion-pictures/about-this-collection/> accessed 1 September 2025.

Diya Shankar & Sudipta De Sarkar, ‘Combatting Deep-Fakes in India - An Analysis of the Evolving Legal Paradigm and Its Challenges’ (2024) 15 Indian JL & Just 346

Ibid.

M. Norman J, ‘ History of Information’ (Video Rewrite, Origins of Deepfakes – History of Information, 11 June 2025) <https://historyofinformation.com/detail.php?=&id= > accessed 1 September 2025

PR O, ‘Gans: An Innovative Technology for Redefining Image and Video Generation’ (OneAdvanced, 10 October 2023) <https://www.oneadvanced.com/resources/gans-an-innovative-technology-for- redefining-image-and-video-generation/ > accessed 27 October 2025

Kingra S, Aggarwal N and Kaur N, ‘Emergence of Deepfakes and Video Tampering Detection Approaches: A Survey - Multimedia Tools and Applications’ (SpringerLink, 5 August 2022) <https://link.springer.com/article/10.1007/s11042-022-13100-x > accessed 24 October 2025

Shimona Mohan & Sarthak Wadhwa, 'Deepfakes and Shallow Laws: Regulating Distorted Narratives in the Political Cyberspace' (2023) 19 Indian J L & Tech 85.

Ibid

Thanh Thi Nguyen and others, ‘Deep Learning for Deepfakes Creation and Detection: A Survey’ (2022) arXiv preprint arXiv:1909.11573v5<https://arxiv.org/abs/1909.11573> accessed 23 October 2025.

Centre for Cybersecurity and Data Privacy (CCoE), 'Understanding Deepfakes: How They Work and Why They Matter' (Cybersecurity Centre of Excellence, 30 December 2023)<https://ccoe.dsci.in/blog/understanding-deepfakes >accessed 23 October 2025.

TechPark A, ‘The Role of Social Media Platforms in Combating Deepfakes’ (AI, 23 September 2024)<https://ai-techpark.com/role-of-social-media-platforms-in-combating-deepfakes/ > accessed 23 October 2025

Unit21, 'Deepfake: How the Technology Works & How to Prevent Fraud' (2025)<https://www.unit21.ai/fraud-aml-

dictionary/deepfake#:~:text=A%20deepfake%20is%20a%20piece,learning%E2%80%9D%20and%20%E2%80%9Cfake.%E2%80%9D> accessed 23 October 2025.

Ibid 6.

Carpenter P, Faik: A Practical Guide to Living in a World of Deepfakes, Disinformation, and Ai-Generated Deceptions (John Wiley & Sons, Inc 2025)

I. Weiner D and Norden L, ‘Regulating AI Deepfakes and Synthetic Media in the Political Arena’(Brennan Center for Justice, 12 December 2023) <https://www.brennancenter.org/our-work/research-reports/regulating-ai-deepfakes-and-synthetic-media-political-arena > accessed 12 October 2025

Wed S by Jamie. karl on, ‘Artificial Intelligence and Investment Fraud’ (Artificial Intelligence and Investment Fraud | Nebraska Banking and Finance, 23 April 2025) <https://ndbf.nebraska.gov/artificial-intelligence-and-investment-fraud > accessed 11 October 2025

Standard B, ‘Deepfake Videos of the NSE Chief Misleading Investors: What You Must Know’ (Business Standard, 11 June 2024) <https://www.business-standard.com/finance/personal-finance/deepfake-videos-of-the-nse-chief-misleading-investors-what-you-must-know-124061100306_1.html > accessed 12 October 2025

TOI Business Desk, 'Beware of deepfake scams! Fraudsters using AI videos to push schemes promising unrealistic returns; red flags to watch out for' (Times of India, 24 September 2025)<https://timesofindia.indiatimes.com/business/financial-literacy/investing/beware-of-deepfake-scams-fraudsters-using-ai-videos-to-push-schemes-promising-unrealistic-returns-red-flags-to-watch-out-for/articleshow/124085155.cms?utm>accessed 16 October 2025.

TOI World Desk, 'I never did that in my life and I never will: UAE Economy Minister warns of deepfake investment scam videos' (Times of India, 14 October 2025) <https://timesofindia.indiatimes.com/world/middle-east/i-never-did-that-in-my-life-and-i-never-will-uae-economy-minister-warns-of-deepfake-investment-scam-videos/articleshow/124547784.cms> accessed 16 October 2025.

SEBI (Prohibition of Fraudulent and Unfair Trade Practices relating to Securities Market) Regulations 2003, reg 2(1)(c).

Kemp S, ‘Digital 2025: India - DataReportal – Global Digital Insights’ (DataReportal, 25 February 2025)<https://datareportal.com/reports/digital-2025 india#:~:text=Social%20media%20statistics%20for%20India,at%20the%20start%20of%202025 > accessed 23 October 2025

Standard B, ‘Retail Participation in Mkts Increase; Demat Accounts Surge to 194 Mn: SEBI’ (Business Standard, 15 July 2025) <https://www.business-standard.com/markets/news/retail-participation-in- mkts-increase-demat-accounts-surge-to-194-mn-sebi-125071500934_1.html > accessed 23 October 2025

Rui Fan, Oleksandr Talavera and Vu Tran, Social Media Bots and Stock Markets (10 March 2019) <https://doi.org/10.13140/RG.2.2.32949.32482 > accessed 24 October 2025.

Money O, ‘Deepfake of Finance Minister Used in Investment Scam: Hyderabad Doctor Loses over Rs 20 Lakh’ (Outlook Money, 18 June 2025) <https://www.outlookmoney.com/news/deepfake-of-finance-minister-used-in-investment-scam-hyderabad-doctor-loses-over-rs-20-lakh?utm > accessed 23 October 2025

KA DrD, ‘Investor Sentiment and Stock Market Volatility: A Behavioral Finance Perspective’ (Journal of Asia-Pacific Business, 1 January 2023) <https://www.academia.edu/126666096/INVESTOR_SENTIMENT_AND_STOCK_MARKET_VOL

ATILITY_A_BEHAVIORAL_FINANCE_PERSPECTIVE > accessed 23 October 2025

Anurag Singh, 'Algorithmic Trading and Market Manipulation: A Legal Perspective on Insider Trading Regulations' (2025) 3 LawFoyer Int'l JDoctrinal Legal Rsch 367

Team C, ‘2010 Flash Crash’ (Corporate Finance Institute, 10 February 2025) <https://corporatefinanceinstitute.com/resources/equities/2010-flash-crash/?utm > accessed 23 October 2025

Speculative Branches, 'The Knight Capital Disaster' (22 November 2023) <https://specbranch.com/posts/knight-capital/?utm> accessed 23 October 2025.

Ben Colman, ‘Detecting Dangerous Ai Is Essential in the Deepfake Era’ (World Economic Forum, 7 July 2025)<https://www.weforum.org/stories/2025/07/why-detecting-dangerous-ai-is-key-to-keeping-trust-alive/?utm> accessed 23 October 2025

Isoni A, ‘State of AI 2024: Why Deepfake Detectors Are Failing (and We Got It)’ (Medium, 2 September 2024)<https://medium.com/predict/state-of-ai-2024-why-deepfake-detectors-are-failing-and-we-got-it-cb2c59065c6e > accessed 23 October 2025

Ibid

Upadhyay JP, ‘After NSE, BSE Cautions Investors on CEO’s Deepfake Videos | Reuters’ (After NSE,BSE cautions investors on CEO’s deepfake videos, 18 April 2024)<https://www.reuters.com/world/india/after-nse-bse-cautions-investors-ceos-deepfake-videos-2024-04-

/ > accessed 23 October 2025.

Kay C, ‘Deepfake “menace” Hurting Retail Investors, Warns Head of India’s BSE Bourse’ (Subscribe to read, 7 May 2024) <https://www.ft.com/content/c441d157-4e76-4374-b685-72c9b5213776?utm > accessed 23 October 2025.

Anurag Singh (n 37) 10

Zhang B and others, ‘Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead’ (MDPI, 22 March 2025) <https://www.mdpi.com/1424-8220/25/7/1989 > accessed 23 October 2025

Ibid

The Constitution of India 1950, art 19(2)

Justice K S Puttaswamy (Retd) & anr v Union of India & ors (2017) 10 SCC 1

Shreya Singhal v Union of India (2015) 5 SCC 1.

The Information Technology Act 2000, s 79.

Aaditya Bhatt, 'Comprehensive Analysis of PFUTP Regulations: A Judicial and Regulatory Framework' (Bhatt & Joshi Associates, 11 April 2025) <https://bhattandjoshiassociates.com/comprehensive-analysis-of-pfutp-regulations-a-judicial-and-

regulatory-framework/> accessed 23 October 2025.

Infibeam Avenues Ltd, Media Release – Infibeam Avenues Ltd and Indian Institute of Sciences (IISc) Signs MoU to Develop Real-Time Deepfake Detection Systems for Government, Corporates, Organisations to Combat Scammers (Press Release, 17 March 2025) <https://www.ia.ooo/wp-content/uploads/2025/03/Press-Release-IAL-IISc-signs-MOU-17-03-2025.pdf>accessed 24 October

Kunal Kamra v Union of India [2023] WP(L) No 9792 (Bom HC)

Abu Dhabi Global Market, 'ADGM Releases Regulatory and Governance Regime for Robo-Advisors' (15 July 2019) <https://www.adgm.com/media/announcements/adgm-releases-regulatory-and-governance-regime-for-robo-advisors > accessed 22 October 2025

Abu Dhabi Global Market, 'FinTech Regulatory Laboratory Guidance' (2016) <https://assets.adgm.com/download/assets/fintech-reglab-guidance.pdf/800da29e606c11ef9c36e210a144be73 > accessed 22 October 2025

Abu Dhabi Global Market, 'Information Technology Risk Management Guidance' (28 November 2023) <https://assets.adgm.com/download/assets/Guidance%2Bon%2BInformation%2BTechnology%2BRisk%2BManagement%2B20231128.pdf/5d78255c87a311ef9eb1d6b5f24f3df1 > accessed 22 October 2025

Financial Conduct Authority, ‘Systems and Controls for Algorithmic Trading’ (FCA Handbook, MAR 5A.5) <https://www.handbook.fca.org.uk/handbook/MAR/5A/5.html > accessed 22 October 2025.

Financial Conduct Authority, 'Algorithmic Trading Compliance in Wholesale Markets' (12 February 2018) <https://www.fca.org.uk/publications/multi-firm-reviews/algorithmic-trading-compliance-wholesale-markets > accessed 22 October 2025.

Financial Conduct Authority, 'Multi-firm Review of Algorithmic Trading Controls: High-Level Observations' (21 August 2025) <https://www.fca.org.uk/publications/multi-firm-reviews/algorithmic- trading-controls-high-level-observations >accessed 22 October 2025.

Financial Conduct Authority, 'Our Supervisory Strategy for Principal Trading Firms' (4 August 2023) <https://www.fca.org.uk/publication/correspondence/portfolio-letter-our-supervisory-strategy-principal-trading-firms.pdf > accessed 22 October 2025.

U.S. Securities and Exchange Commission, 'SEC Launches New Strategic Hub for Innovation and Financial Technology' (Press Release No 2018-240, 18 October 2018)<https://www.sec.gov/newsroom/press-releases/2018-240 > accessed 22 October 2025.

U.S. Securities and Exchange Commission, 'SEC Announces Office Focused on Innovation and Financial Technology' (Press Release No 2020-303, 3 December 2020) <https://www.sec.gov/newsroom/press-releases/2020-303 > accessed 22 October 2025.

Ibid.

U.S. Securities and Exchange Commission, 'Investment Management Guidance Update on Robo-Advisers' (IM Guidance Update No 2017-02, 7 February 2017) <https://www.sec.gov/investment/im-guidance-2017-02.pdf > accessed 22 October 2025.

Financial Industry Regulatory Authority, 'Office of Financial Innovation' <https://www.finra.org/rules-guidance/key-topics/fintech > accessed 22 October 2025.

Financial Industry Regulatory Authority, 'Special Notice on Financial Technology Innovation' (30 July 2018) <https://www.finra.org/sites/default/files/notice_comment_file_ref/SPNotice-7-30_SIFMA_comments.pdf >accessed 22 October 2025.

Financial Industry Regulatory Authority, 'RegTech Initiatives for Surveillance and Monitoring' (17 January 2019)< https://www.finra.org/sites/default/files/2019_RT_RegTech_Surveillance.pdf > accessed 22 October 2025.

Financial Industry Regulatory Authority, 'Artificial Intelligence in the Securities Industry' (20 June 2020) <https://www.finra.org/sites/default/files/2020-06/ai-report-061020.pdf> accessed 22 October 2025.

Bundesanstalt für Finanzdienstleistungsaufsicht (BaFin), Big Data Meets Artificial Intelligence (16 July 2018) <https://www.bafin.de/SharedDocs/Downloads/EN/dl_bdai_studie_en.html >accessed 22 October 2025.

Ibid

BaFin (n 70) 17

Anurag Singh (n 37) 10

SEBI (Prohibition of Fraudulent and Unfair Trade Practices relating to Securities Market) Regulations 2003, reg 3.

SEBI (Prohibition of Fraudulent and Unfair Trade Practices relating to Securities Market) Regulations 2003, reg 4(2)(f).

SEBI (Prohibition of Fraudulent and Unfair Trade Practices relating to Securities Market) Regulations 2003, reg 4(2)(r).

Securities and Exchange Board of India (SEBI), 'Consultation Paper on Proposed Amendments with Respect to Assigning Responsibility for the Use of Artificial Intelligence Tools by Market Infrastructure Institutions, Registered Intermediaries and Other Persons Regulated by SEBI' (13 November 2024) <https://www.sebi.gov.in/reports-and-statistics/reports/nov-2024/proposed-

amendments-with-respect-to-assigning-responsibility-for-the-use-of-artificial-intelligence-tools-by-market-infrastructure-institutions-registered-intermediaries-and-other-persons-regulated-b-_88470.html > accessed 24 October 2025.

Securities and Exchange Board of India (SEBI), 'Consultation Paper on Draft Circular on Recognition as Specified Digital Platform' (22 October 2024) <https://www.sebi.gov.in/reports-and-statistics/reports/oct-2024/consultation-paper-on-recognition-as-specified-digital-platform_87839.html> accessed 24 October 2025.

Securities and Exchange Board of India (SEBI), 'Safer Participation of Retail Investors in Algorithmic Trading' (4 February 2025) Circular No. SEBI/HO/MIRSD/MIRSD-PoD/P/CIR/2025/0000013 <https://www.sebi.gov.in/legal/circulars/feb-2025/safer-participation-of-retail-investors-in-algorithmic-trading_91614.html > accessed 24 October 2025.

Constitution of India, art 19(1)(a)

TOI Tech Desk / TIMESOFINDIA.COM / Updated: Oct 08 2025, ‘Finance Minister Nirmala Sitharaman Announces New Features for Investors to Tackle Deepfake Stock Videos’ (The Times of India, 8 October 2025) <https://timesofindia.indiatimes.com/technology/tech-news/finance-minister-nirmala-sitharaman-announces-new-features-for-investors-to-tackle-deepfake-stock-videos/articleshow/124366809.cms > accessed 24 October 2025

Business Standard, ‘Trai Meets RBI, Sebi, MHA, Meity, Other Regulators on Curbing Spam, Fraud’ (Business Standard, 22 July 2025) <https://www.business-standard.com/industry/news/trai-meets-rbi-sebi-mha-meity-officials-other-sectoral-regulators-on-curbing-spam-fraud-125072201302_1.html > accessed 24 October 2025

International Organization of Securities Commissions (IOSCO), Multilateral Memorandum of Understanding Concerning Consultation and Cooperation and the Exchange of Information (Revised 2021) <https://www.iosco.org/library/pubdocs/pdf/IOSCOPD350.pdf > accessed 24 October 2025.

International Organization of Securities Commissions (IOSCO), Fintech Task Force: Report on AI and Machine Learning in Securities Markets (2023)< https://www.iosco.org/library/pubdocs/pdf/IOSCOPD780.pdf > accessed 24 October 2025.

Financial Stability Board (FSB), Artificial Intelligence and Machine Learning in Financial Services: Market Developments and Financial Stability Implications (2017)<https://www.fsb.org/wp- content/uploads/P011117.pdf > accessed 24 October 2025.

Securities and Exchange Board of India (SEBI), ‘Caution to Investors on Stock Market Scams through Social Media Platforms’ (Press Release 27/2025, 21 May 2025) <https://www.sebi.gov.in/media-and-notifications/press-releases/may-2025/caution-to-investors-on-stock-market-scams-through-social-media-platforms_94064.html >accessed 24 October 2025.

Published

2026-01-27