Regulating AI-Generated Deepfakes in India’s SecuritiesMarket: A Critical Analysis of SEBI’s Role andPolicy Implication
Keywords:
Artificial Intelligence, Deepfakes, Investor Protection, SEBI Regulation, Cyber Fraud in Capital MarketsAbstract
The rapid growth in artificial intelligence (AI), particularly the deep learning technologies, has significantly transformed India’s securities market. It offers a unique set of tools that assist investors and other intermediaries in financial analysis. However, there is a rise in misuse of AI-generated deepfakes and misinformation that impersonate corporate leaders, regulators, and financial experts, misleading the retail investors, manipulating the stock prices and undermining market confidence. This
paper argues that the Securities Exchange Board of India (SEBI) needs to extend its regulatory oversight beyond the registered entities' activity to encompass all forms of AI-driven financial misinformation, including deepfakes. Relying on real-world incidents across India and globally, the paper demonstrates how deepfakes or AI-generated misinformation (particularly in the securities market) have led to losses to investors and market volatility. Although jurisdictional limits, regulatory overlap with the Ministry of Electronics and Information Technology (MeitY), and free speech concerns pose challenges, the paper contends that through effective collaboration, coordinated frameworks, investor education, targeted regulation under the PFUTP Regulations and technological collaboration with the AI research entities, SEBI can effectively address these concerns. Additionally, comparative analysis from the UAE FSRA, UK FCA, US SEC and FINRA and Germany’s BaFin practices further inform a robust policy proposal. Finally, the study investigates SEBI’s proactive intervention, along with balanced inter-agency cooperation, is required to protect the interests of the investors and market integrity in the era of AI.
References
1. Bond S. ‘Fake viral images of an explosion at the Pentagon were probably created by AI’ (NPR, 22 May 2023). https://www.npr.org/2023/05/22/1177590231/fake-viral-images-of-an-explosion-at-the-pentagon-were-probably-created-by-ai. Accessed 19 October 2025.
2. Dogru I. ‘Fake image of Pentagon blast sparks US stock market panic’ (Anadolu Agency, 24 May 2023). https://www.aa.com.tr/en/fact-check/fake-image-of-pentagon-blast-sparks-us-stock-market -panic/2904718. Accessed 19 October 2025.
3. Thakur N. ‘AI in Online Trading – How Artificial Intelligence is Changing Stock Markets’ (Swastika Investmart Ltd Blog, 9 September 2025). https://www.swastika.co.in/blog/ai-in-online-trading---how-artificial-intelligence-is-changing-stock-markets. Accessed 19 October 2025.
4. Ibid.
5. Emett S, Eulerich M, Pickerd J, Wood DA. ‘Short and Synthetically Distort: Investor Reactions to Deepfake Financial News’ (June 2024) SSRN 4869830. https://ssrn.com/abstract=4869830. Accessed 24 October 2025.
6. Boston Institute of Analytics. ‘The Rise of Finfluencers: How Social Media Is Reshaping Investment Decisions in 2025’ (Boston Institute of Analytics, 3 May 2025). https:// bostoninstituteofanalytics.org/blog/the-rise-of-finfluencers-how-social-media-is-reshaping-investment-decisions-in-2025/. Accessed 23 October 2025.
7. Nema P. ‘Understanding Copyright Issues Entailing Deepfakes in India’ (2021) 29 Int J Law Inf Technol 241. doi: https://doi.org/10.1093/ijlit/eaab007. (Advance Access Publication Date: 25 October 2021).
8. Jacobson N. ‘Deepfakes and Their Impact on Society’ (CPI OpenFox Blog, 26 February 2024). https://www.openfox.com/deepfakes-and-their-impact-on-society/. Accessed 19 October 2025.
9. Oza P, Patel N, Patel A. ‘Deepfake Technology: Overview and Emerging Trends in Social Media’ (2024). Department of Computer Science and Engineering, PP Savani University.
10. Kulkarni S. ‘Deepfake video of stock market expert used for online share trading fraud’ (Indian Express, 17 October 2023). https://indianexpress.com/article/cities/pune/deepfake-video-stock-market-expert-online-share-trading-fraud-9662608/. Accessed 19 October 2025.
11. TNN. ‘NSE Flags “deepfake” Video of MD Sharing Stock Tips - Times of India’ (The Times of India). <https://timesofindia.indiatimes.com/business/india-business/nse-flags-deepfake-video-of-md-sharing-stock-tips/articleshow/109208724.cms. Accessed 19 October 2025.
12. Library of Congress. The Spanish-American War in Motion Pictures: About This Collection (1998). https://www.loc.gov/collections/spanish-american-war-in-motion-pictures/about-this-collection/. Accessed 1 September 2025.
13. Shankar D, De Sarkar S. ‘Combatting Deep-Fakes in India - An Analysis of the Evolving Legal Paradigm and Its Challenges’ (2024) 15 Indian JL & Just 346.
14. Ibid.
15. Norman JM. ‘History of Information’ (Video Rewrite, Origins of Deepfakes – History of Information, 11 June 2025). https://historyofinformation.com/detail.php?=&id=. accessed 1 September 2025.
16. PR, ‘Gans: An Innovative Technology for Redefining Image and Video Generation’ (OneAdvanced, 10 October 2023). https://www.oneadvanced.com/resources/gans-an-innovative-technology-for-redefining-image-and-video-generation/. Accessed 27 October 2025.
17. Kingra S, Aggarwal N, Kaur N. ‘Emergence of Deepfakes and Video Tampering Detection Approaches: A Survey - Multimed Tools Appl’ (SpringerLink, 5 August 2022). https://link. springer.com/article/10.1007/s11042-022-13100-x. Accessed 24 October 2025.
18. Mohan S, Wadhwa S. ‘Deepfakes and Shallow Laws: Regulating Distorted Narratives in the Political Cyberspace’ (2023) 19 Indian J L & Tech 85.
19. Ibid.
20. Nguyen TT, et al. ‘Deep Learning for Deepfakes Creation and Detection: A Survey’ (2022). arXiv preprint arXiv:1909.11573v5. https://arxiv.org/abs/1909.11573. Accessed 23 October 2025.
21. Centre for Cybersecurity and Data Privacy (CCoE). ‘Understanding Deepfakes: How They Work and Why They Matter’ (Cybersecurity Centre of Excellence, 30 December 2023). https://ccoe. dsci.in/blog/understanding-deepfakes. Accessed 23 October 2025.
22. TechPark A. ‘The Role of Social Media Platforms in Combating Deepfakes’ (AI, 23 September 2024). https://ai-techpark.com/role-of-social-media-platforms-in-combating-deepfakes/. Accessed 23 October 2025.
23. Unit21. ‘Deepfake: How the Technology Works & How to Prevent Fraud’ (2025). https://www. unit21.ai/fraud-aml-dictionary/deepfake#:~:text=A%20deepfake%20is%20a%20piece,learning% E2%80%9D%20and%20%E2%80%9Cfake.%E2%80%9D. Accessed 23 October 2025.
24. Ibid. 6.
25. Carpenter P. Faik: A Practical Guide to Living in a World of Deepfakes, Disinformation, and Ai-Generated Deceptions (John Wiley & Sons, Inc 2025).
26. Weiner D, Norden L. ‘Regulating AI Deepfakes and Synthetic Media in the Political Arena’ (Brennan Center for Justice, 12 December 2023). https://www.brennancenter.org/our-work /research-reports/regulating-ai-deepfakes-and-synthetic-media-political-arena. Accessed 12 October 2025.
27. Wed S by Jamie. Karlon. ‘Artificial Intelligence and Investment Fraud’ (Artificial Intelligence and Investment Fraud | Nebraska Banking and Finance, 23 April 2025. https://ndbf.nebraska.gov/ artificial-intelligence-and-investment-fraud. Accessed 11 October 2025.
28. Standard B. ‘Deepfake Videos of the NSE Chief Misleading Investors: What You Must Know’ (Business Standard, 11 June 2024). https://www.business-standard.com/finance/personal-finance/ deepfake-videos-of-the-nse-chief-misleading-investors-what-you-must-know-124061100306_1.html. Accessed 12 October 2025.
29. TOI Business Desk. ‘Beware of deepfake scams! Fraudsters using AI videos to push schemes promising unrealistic returns; red flags to watch out for’ (Times of India, 24 September 2025). https://timesofindia.indiatimes.com/business/financial-literacy/investing/beware-of-deepfake-scams-fraudsters-using-ai-videos-to-push-schemes-promising-unrealistic-returns-red-flags-to-watch-out-for/articleshow/124085155.cms?utm. Accessed 16 October 2025.
30. TOI World Desk. ‘I never did that in my life and I never will: UAE Economy Minister warns of deepfake investment scam videos’ (Times of India, 14 October 2025). https://timesofindia. indiatimes.com/world/middle-east/i-never-did-that-in-my-life-and-i-never-will-uae-economy-minister-warns-of-deepfake-investment-scam-videos/articleshow/124547784.cms. Accessed 16 October 2025.
31. SEBI (Prohibition of Fraudulent and Unfair Trade Practices relating to Securities Market) Regulations 2003, reg 2(1)(c).
32. Kemp S. ‘Digital 2025: India - DataReportal – Global Digital Insights’ (DataReportal, 25 February 2025). https://datareportal.com/reports/digital-2025-india#:~:text=Social%20media%20statistics %20for%20India,at%20the%20start%20of%202025. Accessed 23 October 2025.
33. Standard B. ‘Retail Participation in Mkts Increase; Demat Accounts Surge to 194 Mn: SEBI’ (Business Standard, 15 July 2025). https://www.business-standard.com/markets/news/retail-participation-in-mkts-increase-demat-accounts-surge-to-194-mn-sebi-125071500934_1.html. Accessed 23 October 2025.
34. Fan R, Talavera O, Tran V. Social Media Bots and Stock Markets (10 March 2019). https://doi.org/10.13140/RG.2.2.32949.32482. Accessed 24 October 2025.
35. Money O. ‘Deepfake of Finance Minister Used in Investment Scam: Hyderabad Doctor Loses over Rs 20 Lakh’ (Outlook Money, 18 June 2025). https://www.outlookmoney.com/news/deepfake-of-finance-minister-used-in-investment-scam-hyderabad-doctor-loses-over-rs-20-lakh?utm. Accessed 23 October 2025.
36. KA DrD. ‘Investor Sentiment and Stock Market Volatility: A Behavioral Finance Perspective’ (Journal of Asia-Pacific Business, 1 January 2023). https://www.Academia.Edu/126666096/ Investor_Sentiment_And_Stock_Market_Volatility_A_Behavioral_Finance_Perspective. Accessed 23 October 2025.
37. Singh A. ‘Algorithmic Trading and Market Manipulation: A Legal Perspective on Insider Trading Regulations’ (2025) 3 LawFoyer Int’l JDoctrinal Legal Rsch 367.
38. Team C. ‘2010 Flash Crash’ (Corporate Finance Institute, 10 February 2025). https:// corporatefinanceinstitute.com/resources/equities/2010-flash-crash/?utm. Accessed 23 October 2025.
39. Speculative Branches. ‘The Knight Capital Disaster’ (22 November 2023). https://specbranch. com/posts/knight-capital/?utm. Accessed 23 October 2025.
40. Colman B. ‘Detecting Dangerous Ai Is Essential in the Deepfake Era’ (World Economic Forum, 7 July 2025). https://www.weforum.org/stories/2025/07/why-detecting-dangerous-ai-is-key-to-keeping-trust-alive/?utm. Accessed 23 October 2025.
41. Isoni A. ‘State of AI 2024: Why Deepfake Detectors Are Failing (and We Got It)’ (Medium, 2 September 2024). https://medium.com/predict/state-of-ai-2024-why-deepfake-detectors-are-failing-and-we-got-it-cb2c59065c6e. Accessed 23 October 2025.
42. Ibid.
43. Upadhyay JP. ‘After NSE, BSE Cautions Investors on CEO’s Deepfake Videos | Reuters’ (Reuters, 18 April 2024). https://www.reuters.com/world/india/after-nse-bse-cautions-investors-ceos-deepfake-videos-2024-04-18/. Accessed 23 October 2025.
44. Kay C. ‘Deepfake “menace” Hurting Retail Investors, Warns Head of India’s BSE Bourse’ (Financial Times, 7 May 2024). https://www.ft.com/content/c441d157-4e76-4374-b685-72c9b52 13776?utm. Accessed 23 October 2025.
45. Singh A. (n 37) 10.
46. Zhang B, et al. ‘Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead’ (MDPI, 22 March 2025). https://www.mdpi.com/1424-8220/25/7/1989. Accessed 23 October 2025.
47. Ibid.
48. The Constitution of India 1950, Art 19(2).
49. Justice K S Puttaswamy (Retd) & anr v Union of India & ors (2017) 10 SCC 1.
50. Shreya Singhal v Union of India (2015) 5 SCC 1.
51. The Information Technology Act 2000, s 79.
52. Bhatt A. ‘Comprehensive Analysis of PFUTP Regulations: A Judicial and Regulatory Framework’ (Bhatt & Joshi Associates, 11 April 2025). https://bhattandjoshiassociates.com/comprehensive-analysis-of-pfutp-regulations-a-judicial-and-regulatory-framework/. Accessed 23 October 2025.
53. Infibeam Avenues Ltd, Media Release – Infibeam Avenues Ltd and Indian Institute of Sciences (IISc) Signs MoU to Develop Real-Time Deepfake Detection Systems for Government, Corporates, Organisations to Combat Scammers (Press Release, 17 March 2025). https://www.ia.ooo/wp-content /uploads/2025/03/Press-Release-IAL-IISc-signs-MOU-17-03-2025.pdf. Accessed 24 October 2025.
54. Kunal Kamra v Union of India [2023] WP(L) No 9792 (Bom HC).
55. Abu Dhabi Global Market. ‘ADGM Releases Regulatory and Governance Regime for Robo-Advisors’ (15 July 2019). https://www.adgm.com/media/announcements/adgm-releases-regulatory-and-governance-regime-for-robo-advisors. Accessed 22 October 2025.
56. Abu Dhabi Global Market. ‘FinTech Regulatory Laboratory Guidance’ (2016). https://assets. adgm.com/download/assets/fintech-reglab-guidance.pdf/800da29e606c11ef9c36e210a144be73. Accessed 22 October 2025.
57. Abu Dhabi Global Market. ‘Information Technology Risk Management Guidance’ (28 November 2023). https://assets.adgm.com/download/assets/Guidance%2Bon%2BInformation%2B Technology%2BRisk%2BManagement%2B20231128.pdf/5d78255c87a311ef9eb1d6b5f24f3df1. Accessed 22 October 2025.
58. Financial Conduct Authority. ‘Systems and Controls for Algorithmic Trading’ (FCA Handbook, MAR 5A.5). https://www.handbook.fca.org.uk/handbook/MAR/5A/5.html. Accessed 22 October 2025.
59. Financial Conduct Authority. ‘Algorithmic Trading Compliance in Wholesale Markets’ (12 February 2018). https://www.fca.org.uk/publications/multi-firm-reviews/algorithmic-trading-compliance-wholesale-markets. Accessed 22 October 2025.
60. Financial Conduct Authority. ‘Multi-firm Review of Algorithmic Trading Controls: High-Level Observations’ (21 August 2025). https://www.fca.org.uk/publications/multi-firm-reviews /algorithmic-trading-controls-high-level-observations. Accessed 22 October 2025.
61. Financial Conduct Authority. ‘Our Supervisory Strategy for Principal Trading Firms’ (4 August 2023). https://www.fca.org.uk/publication/correspondence/portfolio-letter-our-supervisory-strategy-principal-trading-firms.pdf. Accessed 22 October 2025.
62. U.S. Securities and Exchange Commission. ‘SEC Launches New Strategic Hub for Innovation and Financial Technology’ (Press Release No 2018-240, 18 October 2018). https://www.sec.gov/ newsroom/press-releases/2018-240. Accessed 22 October 2025.
63. U.S. Securities and Exchange Commission. ‘SEC Announces Office Focused on Innovation and Financial Technology’ (Press Release No 2020-303, 3 December 2020). https://www.sec.gov/ newsroom/press-releases/2020-303. Accessed 22 October 2025.
64. Ibid.
65. U.S. Securities and Exchange Commission. ‘Investment Management Guidance Update on Robo-Advisers’ (IM Guidance Update No 2017-02, 7 February 2017). https://www.sec.gov/investment/ im-guidance-2017-02.pdf. Accessed 22 October 2025.
66. Financial Industry Regulatory Authority. ‘Office of Financial Innovation’. https://www.finra. org/rules-guidance/key-topics/fintech. Accessed 22 October 2025.
67. Financial Industry Regulatory Authority. ‘Special Notice on Financial Technology Innovation’ (30 July 2018). https://www.finra.org/sites/default/files/notice_comment_file_ref/SPNotice-7-30_ SIFMA_comments.pdf. Accessed 22 October 2025.
68. Financial Industry Regulatory Authority. ‘RegTech Initiatives for Surveillance and Monitoring’ (17 January 2019). https://www.finra.org/sites/default/files/2019_RT_RegTech_Surveillance.pdf. Accessed 22 October 2025.
69. Financial Industry Regulatory Authority. ‘Artificial Intelligence in the Securities Industry’ (20 June 2020). https://www.finra.org/sites/default/files/2020-06/ai-report-061020.pdf accessed 22 October 2025.
70. BaFin. Big Data Meets Artificial Intelligence (16 July 2018). https://www.bafin.de/SharedDocs/ Downloads/EN/dl_bdai_studie_en.html. Accessed 22 October 2025.
71. Ibid.
72. BaFin. (n 70) 17.
73. Anurag Singh. (n 37) 10.
74. SEBI (Prohibition of Fraudulent and Unfair Trade Practices relating to Securities Market) Regulations 2003, reg 3.
75. SEBI (Prohibition of Fraudulent and Unfair Trade Practices relating to Securities Market) Regulations 2003, reg 4(2)(f).
76. SEBI (Prohibition of Fraudulent and Unfair Trade Practices relating to Securities Market) Regulations 2003, reg 4(2)(r).
77. Securities and Exchange Board of India (SEBI). ‘Consultation Paper on Proposed Amendments with Respect to Assigning Responsibility for the Use of Artificial Intelligence Tools by Market Infrastructure Institutions, Registered Intermediaries and Other Persons Regulated by SEBI’ (13 November 2024). https://www.sebi.gov.in/reports-and-statistics/reports/nov-2024/proposed-amendments-with-respect-to-assigning-responsibility-for-the-use-of-artificial-intelligence-tools-by-market-infrastructure-institutions-registered-intermediaries-and-other-persons-regulated-b-_88470.html. Accessed 24 October 2025.
78. Securities and Exchange Board of India (SEBI). ‘Consultation Paper on Draft Circular on Recognition as Specified Digital Platform’ (22 October 2024). https://www.sebi.gov.in/reports-and-statistics/reports/oct-2024/consultation-paper-on-recognition-as-specified-digital-platform_87839.html. Accessed 24 October 2025.
79. Securities and Exchange Board of India (SEBI). ‘Safer Participation of Retail Investors in Algorithmic Trading’ (4 February 2025) Circular No. SEBI/HO/MIRSD/MIRSD-PoD/P/CIR/ 2025/0000013. https://www.sebi.gov.in/legal/circulars/feb-2025/safer-participation-of-retail-investors-in-algorithmic-trading_91614.html. Accessed 24 October 2025.
80. Constitution of India. art 19(1)(a).
81. TOI Tech Desk. ‘Finance Minister Nirmala Sitharaman Announces New Features for Investors to Tackle Deepfake Stock Videos’ (The Times of India, 8 October 2025). https://timesofindia. indiatimes.com/technology/tech-news/finance-minister-nirmala-sitharaman-announces-new-features-for-investors-to-tackle-deepfake-stock-videos/articleshow/124366809.cms. Accessed 24 October 2025.
82. Business Standard. ‘Trai Meets RBI, Sebi, MHA, Meity. Other Regulators on Curbing Spam, Fraud’ (Business Standard, 22 July 2025). https://www.business-standard.com/industry/news/trai-meets-rbi-sebi-mha-meity-officials-other-sectoral-regulators-on-curbing-spam-fraud-125072201302_1.html. Accessed 24 October 2025.
83. International Organization of Securities Commissions (IOSCO). Multilateral Memorandum of Understanding Concerning Consultation and Cooperation and the Exchange of Information (Revised 2021). https://www.iosco.org/library/pubdocs/pdf/IOSCOPD350.pdf. accessed 24 October 2025.
84. International Organization of Securities Commissions (IOSCO). Fintech Task Force: Report on AI and Machine Learning in Securities Markets (2023). https://www.iosco.org/library/pubdocs/ pdf/IOSCOPD780.pdf. Accessed 24 October 2025.
85. Financial Stability Board (FSB). Artificial Intelligence and Machine Learning in Financial Services: Market Developments and Financial Stability Implications (2017). https://www.fsb.org/ wp-content/uploads/P011117.pdf. Accessed 24 October 2025.
86. Securities and Exchange Board of India (SEBI). ‘Caution to Investors on Stock Market Scams through Social Media Platforms’ (Press Release 27/2025, 21 May 2025). https://www.sebi.gov. in/media-and-notifications/press-releases/may-2025/caution-to-investors-on-stock-market-scams-through-social-media-platforms_94064.html. Accessed 24 October 2025.
