[NORWEGIAN UNIVERSITY OF SCIENCE & TECHNOLOGY] Postdoctoral Fellow in Evaluating Trustworthy and Eff - JOBS.ac.kr(잡스)

{"job":{"jobId":2498507,"fk_accountId":null,"fk_organizationId":1834,"fk_adminAccountId":null,"title":"[NORWEGIAN UNIVERSITY OF SCIENCE & TECHNOLOGY] Postdoctoral Fellow in Evaluating Trustworthy and Eff","description":"\n\nAbout the job\n\n\nThe postdoctoral fellowship position is a temporary position where the main goal is to qualify for work in senior academic positions. \n\n\nThis position is part of TrustLLM Horizon Europe research project that will start in fall 2023, which is partnering with the NorwAI, the Norwegian Research Center for AI Innovation. The project brings together leading European research institutions to lead European development in NLP and AI, and to lay the foundation for a broader European collaboration effort on LLMs and large-scale AI. The project envisions to build a series of LLMs to represent specific language families, in particular the Germanic language family. \n\n\nThe tasks for the team at NorwAI are centered around the creating of datasets for the Norwegian languages and contributing to a common pipeline across partners and languages for the curation and pre-processing of crawled data and existing datasets. Further, together with partners from NorwAI, we will develop prototypes to showcase LLM applications such as text summarization and information mining from corporate documents.\n\n\nThis position will focus on the evaluation of LLMs and entails leading a task on multi-dimensional evaluation metrics for text generation. Furthermore, the position will work together with partners on the creation of a benchmarking platform and benchmarking datasets addressing European values, truthfulness and bias in data and their resulting models.\n\n\nYour immediate leader is the director of NorwAI.\n\n\nDuties of the position\n\n\n<ul>\n<li>Work on benchmark for the evaluation platform of language models</li>\n<li>Develop, test, and deploy evaluation metrics for LLMs </li>\n<li>Develop prototypes on use cases with industrial partners</li>\n<li>Contribute to deliverables and software for the TrustLLM project</li>\n<li>Disseminate the research results through journal or conference publications</li>\n</ul>\n\n\nRequired selection criteria\n\n\n<ul>\n<li>You must have a PhD or a professionally relevant background in AI or language technology . A background from other fields need to describe the relevance for the position.</li>\n<li>Experience with the creation of datasets for building LLMs.</li>\n<li>Experience with the evaluation of LLMs.</li>\n</ul>\n\n\nThe appointment is to be made in accordance with <a data-mz=\"\" href=\"https://lovdata.no/dokument/SF/forskrift/2006-01-31-102\" rel=\"no-follow\">Regulations on terms of employment for positions such as postdoctoral fellow, Ph.D Candidate, research assistant and specialist candidate.</a>\n\n\nPreferred selection criteria\n\n\n<ul>\n<li> Experience using evaluation metrics of LLMs</li>\n<li>Experience working in research teams</li>\n<li>Excellent programming skills</li>\n<li>Strong publication record in language technology</li>\n</ul>\n\n\nPersonal characteristics\n\n\n<ul>\n<li>Ability to take initiative and work independently.</li>\n<li>A positive and professional attitude as well as being a good team-worker.</li>\n<li>Social adaptability and communication skills.</li>\n<li>Willingness to learn new skillsets. </li>\n</ul>\n\n\nEmphasis will be placed on personal and interpersonal qualities.\n\n\nWe offer \n\n\n<ul>\n<li>exciting and stimulating tasks in a strong international academic environment </li>\n<li>an open and<a data-mz=\"\" href=\"https://i.ntnu.no/wiki/-/wiki/Norsk/Inkluderende+arbeidsliv\" rel=\"no-follow\"> inclusive work environment</a> with dedicated colleagues </li>\n<li>favourable terms in the <a data-mz=\"\" href=\"https://www.spk.no/en/\" rel=\"no-follow\">Norwegian Public Service Pension Fund </a></li>\n<li><a data-mz=\"\" href=\"https://innsida.ntnu.no/wiki/-/wiki/English/Benefits+and+discounts\" rel=\"no-follow\">employee benefits </a></li>\n</ul>\n\n\nSalary and conditions\n\n\nAs a Postdoctoral Fellow (code 1352) you are normally paid from gross NOK 594 500 per annum before tax, depending on qualifications and seniority. From the salary, 2% is deducted as a contribution to the Norwegian Public Service Pension Fund.\n\n\nThe period of employment is 3 years. \n\n\nThe engagement is to be made in accordance with the regulations in force concerning <a data-mz=\"\" href=\"https://lovdata.no/dokument/NL/lov/2017-06-16-67\" rel=\"no-follow\">State Employees and Civil Servants</a>, and the acts relating to Control of the Export of Strategic Goods, Services and Technology. Candidates who by assessment of the application and attachment are seen to conflict with the criteria in the latter law will be prohibited from recruitment to NTNU.  \n\n\nAfter the appointment you must assume that there may be changes in the area of work.\n\n\nThe position is subject to external funding through the TrustLLM project, running for 4 years from fall 2023.\n\n\nIt is a prerequisite you can be present at and accessible to the institution on a daily basis.\n\n\nAbout the application \n\n\nThe application and supporting documentation to be used as the basis for the assessment must be in English or Norwegian.\n\n\nPublications and other scientific work must follow the application. Please note that your application will be considered based solely on information submitted by the application deadline. You must therefore ensure that your application clearly demonstrates how your skills and experience fulfil the criteria specified above.\n\n\nIf, for any reason, you have taken a career break or have had an atypical career and wish to disclose this in your application, the selection committee will take this into account, recognizing that the quantity of your research may be reduced as a result.\n\n\nThe application must include:\n\n\n<ul>\n<li>CV and certificates .</li>\n<li>Transcripts and diplomas for bachelor's-, master's- and PhD degrees. If you have not yet completed your Ph.D, you must provide confirmation on your estimated date for the doctoral dissertation, or that your PhD thesis has been submitted.</li>\n<li>A copy of the doctoral thesis. If you are close to submitting, or have recently submitted your thesis, you can attach a draft of the thesis. Documentation of a completed doctoral degree must be presented before taking up the position.</li>\n<li>Academic works - published or unpublished - that you would like to be considered in the assessment .</li>\n<li> Research plan.</li>\n<li>Name and contact information of three referees.</li>\n</ul>\n\n\nIf all, or parts, of your education has been taken abroad, we also ask you to attach documentation of the scope and quality of your entire education. Description of the documentation required can be found <a data-mz=\"\" href=\"https://www.ntnu.edu/positions/documentation-requirements-of-academic-credentials\" rel=\"no-follow\">here</a>. If you already have a statement from NOKUT, please attach this as well.\n\n\nJoint works will be considered. If it is difficult to identify your contribution to joint works, you must attach a brief description of your participation. \n\n\nIn the evaluation of which candidate is best qualified, emphasis will be placed on education, experience and personal and interpersonal qualities. Motivation, ambitions, and potential will also count in the assessment of the candidates. \n\n\nNTNU is committed to following evaluation criteria for research quality according to <a data-mz=\"\" href=\"https://www.ascb.org/wp-content/uploads/2017/07/sfdora.pdf\" rel=\"no-follow\">The San Francisco Declaration on Research Assessment - DORA. </a>\n\n\nGeneral information \n\n\n<a data-mz=\"\" href=\"https://www.ntnu.edu/positions/working-at-ntnu\" rel=\"no-follow\">Working at NTNU </a>\n\n\nNTNU believes that inclusion and diversity is a strength. We want our faculty and staff to reflect Norway’s culturally diverse population and we continuously seek to hire the best minds. This enables NTNU to increase productivity and innovation, improve decision making processes, raise employee satisfaction, compete academically with global top-ranking institutions and carry out our social responsibilities within education and research. NTNU emphasizes accessibility and encourages qualified candidates to apply regardless of gender identity, ability status, periods of unemployment or ethnic and cultural background.\n\n\nThe city of Trondheim is a modern European city with a rich cultural scene. Trondheim is the innovation capital of Norway with a population of 200,000. The Norwegian welfare state, including healthcare, schools, kindergartens and overall equality, is probably the best of its kind in the world. Professional subsidized day-care for children is easily available. Furthermore, Trondheim offers great opportunities for education (including international schools) and possibilities to enjoy nature, culture and family life and has low crime rates and clean air quality.\n\n\nAs an employee at NTNU, you must at all times adhere to the changes that the development in the subject entails and the organizational changes that are adopted. \n\n\nA public list of applicants with name, age, job title and municipality of residence is prepared after the application deadline. If you want to reserve yourself from entry on the public applicant list, this must be justified. Assessment will be made in accordance with <a data-mz=\"\" href=\"https://lovdata.no/dokument/NL/lov/2006-05-19-16/KAPITTEL_3#%C2%A725\" rel=\"no-follow\">current legislation</a>. You will be notified if the reservation is not accepted.\n\n\nIf you have any questions about the position, please contact Professor Kerstin Bach, email <a data-mz=\"\" href=\"mailto:Kerstin.bach@ntnu.no\" rel=\"no-follow\">Kerstin.bach@ntnu.no</a>. If you have any questions about the recruitment process, please contact HR, e-mail: <a data-mz=\"\" href=\"mailto:hr@idi.ntnu.no\" rel=\"no-follow\">hr@idi.ntnu.no</a>.\n\n\nIf you think this looks interesting and in line with your qualifications, please submit your application electronically via <a data-mz=\"\" href=\"http://id.jobbnorge.no/Account/Login?ReturnUrl=%2Fauth%2Fauthorize%3Fclient_id%3Djobbnorge.jobseeker.angular%26redirect_uri%3Dhttps%253A%252F%252Fwww.jobbnorge.no%252Fjobseeker%252FSignIn%26response_type%3Dtoken\" rel=\"no-follow\" target=\"_blank\">jobbnorge.no</a> with your CV, diplomas and certificates attached. Applications submitted elsewhere will not be considered. Upon request, you must be able to obtain certified copies of your documentation. \n\n\nApplication deadline: 27.11.23 \n\n\n\n\n\nNTNU - knowledge for a better world\n\n\nThe Norwegian University of Science and Technology (NTNU) creates knowledge for a better world and solutions that can change everyday life. \n\n\nDepartment of Computer Science \n\n\nWe are the leading academic IT environment in Norway, and offer a wide range of theoretical and applied IT programmes of study at all levels. Our subject areas include hardware, algorithms, visual computing, AI, databases, software engineering, information systems, learning technology, HCI, CSCW, IT operations and applied data processing. The Department has groups in both Trondheim and Gjøvik. The <a data-mz=\"\" href=\"https://www.ntnu.edu/idi\" rel=\"no-follow\" target=\"_blank\">Department of Computer Science </a>is one of seven departments in the <a data-mz=\"\" href=\"https://www.ntnu.no/ie\" rel=\"no-follow\" target=\"_blank\">Faculty of Information Technology and Electrical Engineering </a>.\n\n\nQuestions about the position\nKerstin Bach\n<a data-mz=\"\" href=\"mailto:Kerstin.bach@ntnu.no\" rel=\"no-follow\">Kerstin.bach@ntnu.no</a>\n\n\nDeadline 27th November 2023\nEmployer <a data-mz=\"\" href=\"http://www.ntnu.no/\" rel=\"no-follow\" target=\"_blank\">NTNU - Norwegian University of Science and Technology</a>\nMunicipality Trondheim\nScope Fulltime\nDuration Temporary\nPlace of service Høgskoleringen 1, 7491 Trondheim\n\n\n","pdfUrl1":null,"location":"Trondheim, Norway","location1":"유럽","location2":null,"location3":null,"type":"2","applyUrl":"https://www.jobbnorge.no/jobseeker/#/application/apply/252181","fileUrl1":null,"fileUrl2":null,"fileUrl3":null,"fileUrl4":null,"fileUrl5":null,"fileUrl6":null,"fileUrl7":null,"workingHour":"Full Time","contractType":"Temporary","salary":null,"original_id":"UNI|356680","original_domain":"timeshighereducation.com","original_url":"https://www.timeshighereducation.com/unijobs/listing/356680","original_isPremium":null,"closeType":1,"closedAt":"2023-11-27T00:00:00.000Z","requireEducation":10,"managerTel":"","managerFax":null,"managerEmail":"Kerstin.bach@ntnu.no","managerName":"NORWEGIAN UNIVERSITY OF SCIENCE & TECHNOLOGY ","managerPhone":null,"managerAddress":"Trondheim, Norway","log_hit":0,"log_like":0,"publishState":1,"organizationName":null,"organizationName_en":null,"organizationName_alt":null,"del_yn":"N","createdAt":"2023-10-31T13:23:20.000Z","updatedAt":"2023-11-01T09:37:59.000Z"},"organization":{"organizationId":1834,"lv1Id":null,"lv2Id":null,"name":"NORWEGIAN UNIVERSITY OF SCIENCE & TECHNOLOGY","name_en":"NORWEGIAN UNIVERSITY OF SCIENCE & TECHNOLOGY ","name_alt":",NORWEGIAN UNIVERSITY OF SCIENCE & TECHNOLOGY,","introduction":"NTNU is a university with an international focus, with headquarters in <a href=\"https://www.ntnu.edu/lifeandhousing/trondheim\">Trondheim</a> and campuses in <a href=\"https://www.ntnu.edu/alesund\">Ålesund</a> and <a href=\"https://www.ntnu.edu/gjovik\">Gjøvik</a>.NTNU has a main profile in science and technology, a variety of programmes of professional study, and great academic breadth that also includes the humanities, social sciences, economics, medicine, health sciences, educational science, architecture, entrepreneurship, art disciplines and artistic activities.&nbsp;<h2>Organization, budget and employees</h2><ul><li><a href=\"https://www.ntnu.edu/faculties\">Nine faculties and faculty level groups and&nbsp;55&nbsp;departments</a></li><li>Budget: NOK 9,6&nbsp;billion, of which NOK 2,7 billion from external sources (2019)</li><li>7600&nbsp;full-time equivalents (FTEs) (2019).&nbsp;Two of three (4978)&nbsp;work with teaching, research and dissemination&nbsp;(academic positions), off which more than 42&nbsp;per cent are women and more than 30 per cent are international.</li><li><a href=\"https://www.ntnu.edu/research/partnership\">Close cooperation with SINTEF</a>, an R&amp;D organization with 1800 employees (both co-located with NTNU in Trondheim, and in Oslo)</li><li>Facilities (owned or rented) totalling 734&nbsp;000 m2</li><li><a href=\"https://www.ntnu.edu/ub/\">University Library</a>&nbsp;with&nbsp;16&nbsp;library departments, 2 million printed books,&nbsp;925&nbsp;000 e-books, 275 databases&nbsp;and over&nbsp;3 million&nbsp;annual full-text article downloads</li><li>&nbsp;</li></ul><h2>Studies</h2><ul><li>Specialization in technology and the natural sciences. 75 per cent of Norway's&nbsp;master candidates in technology</li><li>Educates most teachers (teacher training, lecturer, primary school, vocational), and in health and fine arts in Norway</li><li>Also offers a range of&nbsp;<a href=\"https://www.ntnu.edu/studies/allstudies\">bachelor's, master's and doctoral programmes</a>&nbsp;in humanities, social sciences, economics, medicine, health sciences, educational sciences, architecture, entrepreneurship and aesthetic disciplines</li><li>Professional degree programmes in medicine, psychology, architecture, the fine arts, music, and teacher education, in addition to technology</li><li>371 study programmes (2019), as well as further education</li><li>41 971&nbsp;registered&nbsp;students, of which about half study technology and the natural sciences (2019)</li><li>3629 (9 per cent) of the students are international, from 119 countries (2019)</li><li>Just over half of the students are women (2019)</li><li>Almost half of the students are in technical and natural sciences programmes (2019)</li><li>4175 registered students in&nbsp;<a href=\"https://www.ntnu.edu/continuing-education\">further education programmes</a>, experience-based master's and ICT courses (2018)</li><li>7220 bachelor's and master's degrees awarded (2018)</li><li>Dozens of international student exchange programmes and more than 300 cooperative or exchange agreements with 60 universities worldwide</li><li>More than 38 000 alumns worldwide</li><li>&nbsp;</li></ul><h2>Research and collaboration with business</h2><ul><li>Doctoral&nbsp;degrees: 394&nbsp;(2019)</li><li><a href=\"https://www.ntnu.edu/research/lab\">Many large and small aboratories</a></li><li>Horizon&nbsp;2020: <a href=\"https://www.ntnu.edu/horizon\">154 signed&nbsp;projects</a>&nbsp;(September 2019)</li><li><a href=\"https://www.ntnu.no/forskning/satsingsomraader\">Four Strategic Research Areas</a>&nbsp;in the period&nbsp;2014–2023</li><li><a href=\"https://www.ntnu.edu/innovation-resources\">Innovation Resources</a></li><li>&nbsp;</li></ul><h2>Strategies, plans and reports</h2><ul><li><a href=\"https://www.ntnu.edu/organization\">Strategies, plans and reports</a></li><li><a href=\"https://innsida.ntnu.no/wiki/-/wiki/English/Ready-made+presentations+about+NTNU\">Presentations about NTNU</a></li><li>&nbsp;</li></ul><h2>The history of NTNU</h2><ul><li><a href=\"https://www.nobelprize.org/prizes/medicine/2014/summary/\">The Nobel Prize in Medicine or Physiology 2014</a>&nbsp;was awarded to the brain researchers May-Britt Moser and Edvard Moser at NTNU and&nbsp;John O'Keefe at&nbsp;University College London.</li><li>Two students at former&nbsp;<a href=\"https://en.wikipedia.org/wiki/Norwegian_Institute_of_Technology\">NTH – Norwegian Institute of Technology</a>&nbsp;are awarded the Nobel Prize:&nbsp;<a href=\"https://www.nobelprize.org/prizes/physics/1973/summary/\">Ivar Giæver in Physics 1973</a>&nbsp;and&nbsp;<a href=\"https://www.nobelprize.org/prizes/chemistry/1968/summary/\">Lars Onsager in Chemistry 1968</a></li><li>NTNU was established in 1996 after the&nbsp;merger of six research and higher educational institutions in Trondheim.</li><li><a href=\"https://en.wikipedia.org/wiki/Norwegian_University_of_Science_and_Technology#History\">More about the history of NTNU</a>.</li></ul>","logoImg":"https://researchtestjob.s3.amazonaws.com/assets/logo/1834-logo.png","logoImgSquare":"https://s3.ap-northeast-2.amazonaws.com/jobs.ac.kr/dev/images/wkjelsjdflksjfl_1537498316760.png","homepageUrl":"https://www.ntnu.edu/","infoUrl":null,"country":"NO","state":"Trondheim","location":"유럽","address":"Høgskoleringen 1, 7491 Trondheim, Norway","phoneNumber":"+47 73 59 50 00","faxNumber":null,"type":1,"univType1":"","univType2":"대학교","univType3":"","univType4":"","establishedAt":"1760-01-01T00:00:00.000Z","count_majors":null,"count_students":null,"meta_competitiveness":null,"publishState":1,"updatedAt":"2021-10-11T14:12:15.000Z","createdAt":"2020-03-04T20:13:07.000Z","default_1_bannerImage":"https://s3.ap-northeast-2.amazonaws.com/jobs.ac.kr/dev/images/ntnu_220573992782.png","default_1_bannerImageMobile":"https://s3.ap-northeast-2.amazonaws.com/jobs.ac.kr/dev/images/ntnu_m_332661862658.png","default_2_bannerImage":"https://s3.ap-northeast-2.amazonaws.com/jobs.ac.kr/dev/images/gold_NORWEGIAN_958652504085.png","default_2_bannerImageMobile":"https://s3.ap-northeast-2.amazonaws.com/jobs.ac.kr/dev/images/gold_m_NORWEGIAN_970845399410.png","default_3_bannerImage":"https://s3.ap-northeast-2.amazonaws.com/jobs.ac.kr/dev/images/NORWEGIANUNIVERSITYOFSCIENCE&TECHNOLOGY_1424619533704.jpg","default_3_bannerImageMobile":"https://s3.ap-northeast-2.amazonaws.com/jobs.ac.kr/dev/images/NORWEGIANUNIVERSITYOFSCIENCE&TECHNOLOGY_1330110681812.jpg"}}