AI Governance in the Era of Agentic Generative AI and AGI: Frameworks, Risks, and Policy Directions

Satyadhar Joshi

doi:10.55524/ijircst.2025.13.5.3

Abstract

The accelerating development of agentic artificial intelligence (AI) and the prospect of artificial general intelligence (AGI) create unprecedented opportunities alongside complex governance challenges. This paper examines the ethical, regulatory, and technical dimensions of governing highly autonomous AI systems, drawing upon more than fifty contemporary academic and policy sources. Three core insights emerge. First, current governance structures provide limited coverage of risks linked to recursive self-improvement and multi-agent coordination, with only an estimated 10–15% of safety research addressing impacts that arise after deployment. Second, economic projections suggest that agentic AI could generate between 2.6 and 4.4 trillion USD in added global output by 2030, yet automation could replace approximately 28–42% of existing job tasks, making proactive workforce transition strategies a policy necessity. Third, fragmented regulatory approaches remain a concern; in the United States, for example, 70–75% of critical infrastructure is considered vulnerable to adversarial autonomous systems. To address these issues, we propose a governance model built on three pillars: modular agent design, adaptive safety mechanisms, and international coordination. Policy measures such as licensing thresholds for high-computer systems exceeding 10^25 FLOPs, structured red-team testing across public and private sectors, and fiscal incentives for governance-by-design practices are advanced as actionable pathways. Overall, the study argues for adaptive, globally coordinated governance frameworks that balance innovation with systemic risk mitigation in the era of agentic AI and AGI. his is a pure review paper and all results, proposals and findings are from the cited literature.

Keywords

AI Governance, Agentic AI, Generative AI, Artificial General Intelligence (AGI), Ethics, Policy, Risk Management, Recursive Self-Improvement, Multi-Agent Systems, Workforce Transition, International Coordination

References

P. Upmann, “Agentic AI: When Machines Set Goals – and We Risk Losing Control,” LinkedIn Pulse. Available from: https://tinyurl.com/3fje4h49
MKWriteshere, “AI Agents vs. Agentic AI: From Solo Performers to Orchestrated Intelligence,” Medium, May 2025.
T. Wolff, “Agentic AI: A Strategic Forecast and Market Analysis (2025–2030),” Jul. 2025. Available from: https://tinyurl.com/mr3cwtzt
K. W. Carlson, “Highlights of the Issue: Governance, Agents, Evolutionary Search: In progress,” SuperIntelligence – Robotics – Safety & Alignment, vol. 2, no. 3, Jul. 2025. Available from: https://doi.org/10.70777/si.v2i3.15417
Global Skill Development Council, “Critical Risks and Concerns in Agentic AI Deployment.” Available from: https://tinyurl.com/ysjpdt9t
European Union, “EU Artificial Intelligence Act: Up-to-date developments and analyses.”
International Telecommunication Union, “AI governance in practice: Developing secure and innovative frameworks,” ITU Academy, Apr. 2025. Available from: https://tinyurl.com/mr4ab3cs
N. Kshetri, “Governing Agentic AI: Security, Identity, and Oversight in the Age of Autonomous Intelligent Systems,” Computer, vol. 58, no. 8, pp. 123–129, Aug. 2025. Available from: https://ieeexplore.ieee.org/abstract/document/11104161
Teaganne Finn, IBM, “Agentic AI vs. Generative AI,” IBM Think, Feb. 2025. Available from: http://hdl.handle.net/10400.5/102853
Joe Green, Deloitte, “AI deployment security and governance,” Artificial Intelligence News. Available from: https://tinyurl.com/4xmt3udh
Vereinte Nationen, Governing AI for Humanity: Report, New York, NY: United Nations, 2024. Available from: https://tinyurl.com/4ebkf2fr
“Beyond automation: How AGI will reshape decision-making, innovation, and governance,” TechRadar. Available from: https://tinyurl.com/3zjfu63r
T. Malhotra, “Top Artificial Intelligence (AI) Governance Laws and Frameworks,” May 2024.
Harry Hawk, “Agentic AI vs Generative AI: What’s the Difference and Why It Matters,” Jun. 2021.
M. Maas, “Concepts in advanced AI governance: A literature review of key terms and definitions,” Oct. 2023. Available from: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4612473
NeuroCortex.AI, “Navigating the Landscape: Ethics, Governance, and Challenges in Generative AI,” Jun. 2024.
Y. Arenas, “Agent Factory: The new era of agentic AI—common use cases and design patterns,” Aug. 2025.
R. Blackman, “Organizations Aren’t Ready for the Risks of Agentic AI,” Harvard Business Review. Available from: https://doi.org/10.1111/joms.13274
“AI governance for the agentic AI era,” KPMG. Available from: https://tinyurl.com/4np2mr8u
Al-Maamari, "Between Innovation and Oversight: A Cross-Regional Study of AI Risk Management Frameworks in the EU, US, UK, and China," arXiv preprint arXiv:2503.05773, 2025. Available from: https://doi.org/10.48550/arXiv.2503.05773
Kitishian, “State of Agentic AI in the Enterprise - Klover.ai,” Jul. 2025.
Chai Wutiwiwatchai, “3 Approaches to AI Governance: Why ’Standards’ Must Precede ’Laws’ - AI Thailand.” Available from: https://www.ai.in.th/ai-governance-standards-before-legislation/
“Artificial General Intelligence (AGI): Predictions, Risks, Challenges.” Available from: https://www.datacamp.com/blog/agi
P. Upmann, “Governance by Design: Embedding Compliance and Ethics in AI Development,” Dec. 2024.
Paul Haley, “Agentic Compliance: AI-Driven Governance for the Enterprise.” Available from: https://tinyurl.com/bp95fuba
“Governing the Algorithms That Govern Us: Inside the Rise of AI GRC and Agentic Oversight.” Available from: https://tinyurl.com/yemdedfd
Tom Coshow, “How Intelligent Agents in AI Can Work Alone.” Available from: https://www.gartner.com/en/articles/intelligent-agent-in-ai
“Agentic AI, Generative AI and AI Governance.”
Eden Zoller, “Understanding Agentic AI: Attributes, Architecture, and the Ecosystem.” Available from: https://tinyurl.com/3pn6dnkv
G. Yenduri, R. Murugan, P. K. R. Maddikunta, S. Bhattacharya, D. Sudheer, and B. B. Savarala, "Artificial General Intelligence: Advancements, Challenges, and Future Directions in AGI Research," IEEE Access, 2025. Available from: https://ieeexplore.ieee.org/abstract/document/11096544
“AGI vs. ASI in Enterprises: Understanding the AI Revolution.” Available from: https://tinyurl.com/bdfp6ekd
Yves Mulkers, “Redesign Your Workflows or Risk Falling Behind: Inside the Rise of Agentic AI.” Available from: https://tinyurl.com/38rpv5k6
S. Uppili, “AI vs AGI vs ASI: The Ultimate Guide to Understanding Artificial Intelligence Evolution,” Aug. 2025.
Dave Trier, “AI Ethics and Governance.” Available from: https://www.modelop.com/ai-governance/ai-ethics-and-governance
“Ethical Challenges and Governance in Agentic AI: Risks, Bias, and Regulations.” Available from: https://tinyurl.com/bdhwkxte
“Taking a responsible path to AGI.” Available from: https://tinyurl.com/44hwvynd
S. Murugesan, "The rise of agentic AI: implications, concerns, and the path forward," IEEE Intelligent Systems, vol. 40, no. 2, pp. 8–14, 2025. Available from: https://ieeexplore.ieee.org/abstract/document/10962241
S. Krakowski, "Human-AI agency in the age of generative AI," Information and Organization, vol. 35, no. 1, p. 100560, 2025. Available from: https://doi.org/10.1016/j.infoandorg.2025.100560
“The Intersection Between AI Ethics and AI Governance.” Available from: https://tinyurl.com/4zn4zsp9
B. Acharya, K. Kuppan, and B. Divya, "Agentic AI: Autonomous intelligence for complex goals–a comprehensive survey," IEEE Access, 2025. Available from: https://ieeexplore.ieee.org/abstract/document/10849561
S. Hosseini and H. Seilani, "The role of agentic AI in shaping a smart future: A systematic review," Array, 2025, Art. no. 100399. Available from: https://doi.org/10.1016/j.array.2025.100399
“Ethics, Corporate Governance, Algorithms.” Available from: https://tinyurl.com/475enu7r
M. Maas, “Advanced AI governance: A literature review of problems, options, and proposals,” Nov. 2023. Available from: https://tinyurl.com/45zty9us
M. Yazdi, E. Zarei, S. Adumene, and A. Beheshti, "Navigating the power of artificial intelligence in risk management: a comparative analysis," Safety, vol. 10, no. 2, p. 42, 2024. Available from: https://doi.org/10.3390/safety10020042

Cites this article as

S. Joshi "AI Governance in the Era of Agentic Generative AI and AGI: Frameworks, Risks, and Policy Directions", International Journal of Innovative Research in Computer Science and Technology (IJIRCST), Vol-13, Issue-5, Page No-14-24, 2025. Available from: https://doi.org/10.55524/ijircst.2025.13.5.3

Corresponding Author

Satyadhar Joshi

Independent, Global Risk and Anlaytics, BoFA, Jersey City, United States

Download Full Paper

Download PDF

No. of Downloads: 67 | No. of Views: 1887

Threat Defensive Intelligent Trust Framework for Secure FANET Clustering

Shikha Gupta, Deepak Gupta.

March 2026 - Vol 14, Issue 2
Design and Implementation of an Early Detection System for Chronical Kidney Disease Using Machine Learning Techniques

Mohd Shahbaz Khan, Richa Srivastava, Mohd Owais Khan, Faiyaz Ahamad.

March 2026 - Vol 14, Issue 2
Design and Implementation of a Quiz Platform Using AI to Increase Interactivity

Mohd Rafey, Najmus Sahar, Muskan Khatoon, Ajaz Husain Warsi.

March 2026 - Vol 14, Issue 2

AI Governance in the Era of Agentic Generative AI and AGI: Frameworks, Risks, and Policy Directions

Citations

Download Full Paper PDF

Total View 1887

Total Download 67