<\/figure>\n<\/p>\n
In this case, the A.I. got through the series of tasks, and recognized that the budget requirements could be met without layoffs, since several employees were planning to retire or resign before the next fiscal year.<\/p>\n
<\/p>\n
But it also made a meaningful error: When it found that at least three employees were planning to go on leave, it added their roles to the list of jobs that could be cut for the following year, without considering when those employees planned to return.<\/p>\n
<\/p>\n
Where a human might instinctively know to ask how long those leaves would last, the A.I. inferred from that section that all of those employees could be lumped together and written off.<\/p>\n
<\/p>\n
\u201cA.I. may be less capable of replacing tacit knowledge, the idiosyncratic tips and tricks that accumulate with experience but which are never digitized,\u201d researchers at Stanford University and the National Bureau of Economic Research said in a recent study.<\/p>\n
<\/p>\n
The agent also had trouble navigating the Google Drive interface and a spreadsheet. And at the step where the agent was supposed to modify an existing organizational chart in Preview or Google Slides \u2014 a task it likely could have accomplished \u2014 it almost immediately decided that using an app was too impractical and wrote code instead.<\/p>\n
<\/p>\n
\u201cAgents work in a very unhuman way, writing code instead of using the typical interfaces that humans do,\u201d said Graham Neubig, a professor at Carnegie Mellon University and co-author of the AgentCompany research project.<\/p>\n
<\/p>\n
Our agent didn\u2019t just demonstrate that it preferred to code its way through a problem; it also ignored our instructions to attempt to use apps before switching to code. A.I., it seems, understands that it is very good at coding and handling structured data, and less good at navigating applications that were designed for human eyes and intuition.<\/p>\n
<\/p>\n
For the next task, the prompt instructed the A.I. to fill out 17 I-9 employment verification forms, using employee data from a spreadsheet, and upload them to a Google Drive folder.<\/p>\n
<\/p>\n <\/figure>\n<\/p>\n
Despite its instructions, the agent again avoided using an app to do the work, and instead started writing code after about 30 seconds. The programmatic solution did work well, however, and the agent even added a section to the script to make sure the phone and Social Security numbers were formatted correctly.<\/p>\n
<\/p>\n
But after blazing through what would have been a tedious and time-consuming process for a human, the agent then stumbled on a step that would have been trivial for any office worker: uploading the PDF documents to Google Drive.<\/p>\n
<\/p>\n
The results of our experiment roughly matched what researchers and companies have found as they have tested and used artificial intelligence tools. Scale AI, an A.I. training company, recently tested agents on real freelance projects, and the best-scoring model produced client-ready work only about 16 percent of the time.<\/p>\n
<\/p>\n
While A.I. can excel regularly at complex tasks, it can be unreliable when put in charge of an entire job. It can certainly add value to certain areas of the work force, but for now, A.I. still needs a human boss.<\/p>\n
<\/p><\/div>\n\n","protected":false},"excerpt":{"rendered":"
Task 1 Survey colleagues Interacting with humans over Slack was surprisingly easy for the A.I. Task 2 Suggest staff cuts The A.I. completed the task, but made an important error. Task 3 Fill out 17 forms It blazed through the tedious part and struggled with a trivial step. We gave an A.I. tool full access […]<\/p>\n","protected":false},"author":1,"featured_media":30621,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[25],"tags":[],"class_list":["post-30619","post","type-post","status-publish","format-standard","has-post-thumbnail","category-tech-news"],"_links":{"self":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/30619","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=30619"}],"version-history":[{"count":1,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/30619\/revisions"}],"predecessor-version":[{"id":30620,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/30619\/revisions\/30620"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/media\/30621"}],"wp:attachment":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=30619"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=30619"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=30619"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}