The debate on whether AI will take over the world has been a hot topic in recent years . A step forward for the ones who are in favor of this argument has been the integration of AI technology in computers of all sorts. It doesn’t matter if they are handheld devices or desktop computers or embedded computers, all of them are being integrated with AI technology.
In recent times, the biggest shock to the world has been the possibility of an autonomous AI software engineer. At this point in time Software Engineering is one of the widest as well as the most saturated fields in Pakistan . The possibility of existence of a fully autonomous software engineer has had the whole world awe struck . Devin AI is a project of COGNITION AI . It was announced on 12th March 2024 by the CEO Scott Wu . It is still under development and is still far away from replacing software engineers but there has been a debate whether it has the ability to do so or not . Devin is an AI system designed to act as a software engineer. It can write code, debug existing code, and even develop apps and websites based on instructions. Proponents believe Devin represents a significant leap in AI’s role in software development. It has the potential to automate repetitive tasks, freeing up human engineers for more complex work. There’s an open-source project called OpenDevin that aims to replicate and improve upon Devin’s capabilities through collaboration. Devin has been advertised as tireless and capable of completing tasks much faster than humans .
Devin AI consists of the following components : An integrated command line , a code editor and even a browser of its own . It uses all the same tools that a software engineer does . One of the greatest criticism points regarding AI has been that it is incapable of solving real life problems because it cannot comprehend the delicate nature of such problems . Devin AI has a success rate of about 14% in solving real life coding problems which as low as it sounds is still leagues higher than any other public AI platform that has tried solving IRL coding problems . Of course, it is being put through rigorous testing in order to check its true potential as well as its limitations . There have been instances where Devin has been used to do online jobs as well from Upwork and other freelancing platforms . Videos have been uploaded to various social media platforms which walk us through the entire process of Devin accomplishing this amazing feat .
As we know nothing is devoid of faults or flaws , Similarly Devin is no exception . There has been a lot of criticism on this new concept of an AI bot replacing Software Engineers completely and some people going to the extent of saying that there will be no jobs left for Software Engineers after Devin is completed and is presented to us in the form of a polished product since it will be a lot faster and a lot cheaper if not completely free than hiring people to do these jobs.
Critics argue that Devin might struggle with real-world coding challenges that require critical thinking and understanding project context . There has also been concerns regarding the possibility that AI development can also lead to job displacement in certain fields . If this were to occur , there is no doubt that it will lead to cost efficiency for people who hire professionals to do these jobs but on the other hand it will also result in way less jobs as well which may end up causing a global crisis . There have also been questions regarding the reliability of these AI bots and their accuracy since at this point in time the results produced by them have to be checked and validated by humans to ensure their correctness . An argument can also be made that relying too much on AI or replacing humans with AI bots can end up being a hindrance in development of human skills and creativity in the field of Software Engineering .
Another important problem that has been reported is that there is a chance that Devin has been programmed to come up with superficial errors itself and then solve those while giving the impression that it is solving the errors found in the actual prompt or the given set of instructions . Some experts have made videos showcasing Devin and have found inconsistencies . An expert in the field of Software Engineering made a video in which he tried solving one of the problems that Devin solved and he showed that Devin was solving or debugging errors which were actually not present in the task meaning that those specific errors were created by Devin itself in order to give the impression of it being very competent and highly skilled with regard to the job at hand . There were other instances where actual errors present in the program given to Devin were not actually solved by it .
These real life scenarios show us the limitations that the current model of Devin has as well as its way of going about solving a problem with added errors of its own . This illusion that is being created of Devin of it being competent comes under clickbait and the reason behind it is still unknown , whether it has been designed this way deliberately or this occurrence is because Devin is still under development .
The question again arises , Is Devin a possible candidate for replacing Software Engineers ? Or is it just another hype build up for a new technology as a result of clever marketing ? Will Devin’s inability to effectively interact with humans be a major hurdle ?
As of yet Devin is still a paradox . It is still a puzzle that needs to be solved but we do not have enough information to reach a conclusive result . AI is always evolving and the things we are able to achieve with AI today were not even deemed possible a while back . Thus the possibilities are still limitless with this new technology . Will Devin be the end of Software Engineers or will it just end up being a tool that aids them in their work ? There is no doubt about the fact that Devin holds a lot of potential but it has also driven people into two different school of thoughts , those who think that it will be beneficial if it can replace SEs , and others who think that it poses a lot of professional as well as ethical questions.
Group members:
Ayesha Azhar
Muhammad Rayan
Shehryaar shakeel
Fiza Amir
Instructor:
Ayesha Aziz
COMSATS university, Lahore campus
