Prof. Dr. Burhan Pektaş, Head of the Computer Engineering Department, stated that the possibility of artificial intelligence gaining control over humans or causing harm cannot be completely ruled out, saying, “It's difficult to say that such dystopian scenarios are entirely impossible. However, current artificial intelligence (AI) systems operate based on predetermined goals and cannot create their own objectives.”
Prof. Dr. Burhan Pektaş, emphasizing the need for faster development of global cooperation and ethical standards to prevent the potential threats of rapidly developing artificial intelligence today, added, “Although largely hypothetical, the rapid development of AI could pose a real threat in the long term if left uncontrolled.”
Prof. Dr. Burhan Pektaş, Head of the Department of Computer Engineering at Üsküdar University's Faculty of Engineering and Natural Sciences (MDBF), evaluated the possibility of artificial intelligence destroying humanity.
What are Artificial General Intelligence and its risks?
Evaluating the words of Geoffrey Hinton, known as the father of artificial intelligence, regarding the increased possibility of AI technology destroying humanity in the next 30 years, Prof. Dr. Burhan Pektaş said, “Geoffrey Hinton's warning reflects the concern that control mechanisms might be insufficient during the development of artificial intelligence (AI). This view particularly concerns the emergence of systems with human-like learning and decision-making capacities, known as 'artificial general intelligence' (AGI). The risks are as follows; Autonomous control: AI setting its own goals and disregarding human interests to achieve them. Armament risk: The development of autonomous weapons and the dangerous misuse of AI in the wrong hands. Information manipulation: The production of fake information can manipulate elections and societal decision-making processes. Economic control: Large corporations monopolizing AI and increasing income inequality.”
Physical, economic, social, and cultural threats
Prof. Dr. Burhan Pektaş stated that the threats of AI are not limited to physical destruction but also include social, economic, and cultural transformations, listing these threats as follows:
“Physical threats: Autonomous weapon systems, AI applications with security vulnerabilities.
Economic threats: Widespread unemployment resulting from AI replacing the workforce.
Social threats: Digital inequality, the destruction of privacy, and the formation of surveillance societies.
Cultural threats: Erosion of human values and original creativity in competition with AI systems.”
Are ethical and security standards sufficient?
Regarding the development of ethical rules and security standards in artificial intelligence technologies, Prof. Dr. Burhan Pektaş provided the following information:
“Although some progress has been made in this area today (such as the European Union's AI Act), the development of standards at a global level is still slow. The main reasons for this are: Lack of international cooperation: Conflicts of interest between different countries. Technological speed: The pace of AI development surpasses the speed of regulatory implementation. Corporate influence: Lobbying activities of large technology companies.”
Stating that the lobbying activities of large technology companies slow down the process, Prof. Dr. Burhan Pektaş said, “Globally binding rules should be established. Independent auditing bodies should be formed. Ethical awareness should be increased through education programs.”
What are the proposed solutions?
Prof. Dr. Burhan Pektaş also pointed out the steps that should be taken to prevent artificial intelligence from getting out of control, listing his suggestions to prevent it from going rogue as follows:
“Transparency: How all AI models work should be open to the public.
Security tests: Independent tests should be conducted to ensure that AI systems do not cause harm to humans.
International cooperation: Binding agreements should be reached among all countries.
Ethical auditing: Companies developing AI should undergo regular ethical audits.
Kill switch mechanisms: Technical solutions that allow AI to be stopped if it leads to an undesirable situation should be implemented.”
Can dystopian scenarios become reality?
Prof. Dr. Burhan Pektaş stated that the possibility of artificial intelligence gaining control over humans or causing harm cannot be entirely ruled out, saying, “It is difficult to say that such dystopian scenarios are completely impossible. However, current AI systems operate based on predetermined goals and cannot create their own objectives. Nevertheless; Risky scenarios: Autonomous systems operating with incorrect algorithms or being misused by malicious individuals can pose a danger. Element of truth: Although a large part of these risks is hypothetical today, the rapid development of AI could pose a real threat in the long term if left uncontrolled.”