PIECES Framework and Importance Performance Analysis Method to Evaluate the Implementation of Information Systems

. Work plan and budget are solutions in gathering budget planning data and uniforming budgeting. the purpose of the work plan and budget is to assist all work units in preparing and managing the budget plan without mixing it with other units. The importance of performances analysis method and PIECES framework were chosen in this study because both of method were able to classify the insitution problems, opportunities and information system goals. PIECES Framework as a questionnaire criteria to responding the users and the Importance Performance Analysis method as a result of questionnaire data from 88 respondents in the form of Quadrants. The aim of the research to evaluate information systems is a user satisfaction and importance of information systems. The calculation results with IPA method shows that the user's satisfaction averages and the importance of information system quality is 93.71%. However, there are a few deficiencies that need to be improved in the development of information systems, work plans and annual budgets such as system quality, accurate informations, estimated cost of building the system, security systems efficiency and service improvement for users.


Introduction
Budget is a form of statement regarding the estimated performance to be achieved over a certain period of time expressed in financial measures, while budgeting is the purpose of preparing a process or method for preparing a budget [1]. Work plan and budget are solutions in gathering budget planning data and uniforming budgeting. the purpose of the work plan and budget is to assist all work units in preparing and managing the budget plan without mixing it with other units. is needed to provide direction and guidance for the work unit actors in the direction of change or better goals (improvement, development) with little risk and to reduce future uncertainty. Work plan and budget are a form of unity from the details of the measured work plan containing the budget allocation that has been set by the work unit, work agenda / targets / strategies and program of activities to be implemented. Work plans and budgets that focus on current (short-term) operations and especially those related to the goal of achieving efficiency.
Annual work plan and budget or RKAT system are prepared by Diponegoro University to collect planning and budgeting data that will be carried out by Undip in one year. Thus, the management of work plans in Undip can be planned and realized properly with transparent and accountable mechanisms. Diponegoro University RKAT Information System is an application to enter performance targets based on performance indicators and activities. This system helps all work units in setting performance targets to be achieved online. Each unit can fill Sub-activities together with filling the budget through the annual work plan and budget or RKAT without mixing with other units. In addition, the RKAT is also used to revise the budget from the government that has been determined by the Budget Unit Per Work Unit (SAPSK) or Budget Implementation Entry List (DIPA To find out if the RKAT system is running as expected, it needs an evaluation process on the performance of the information system. Evaluation is a form of activity instrument that has been planned to assess a problem that occurred and the results can be compared as a benchmark to obtain conclusions and find solutions to solve problems that will arise. While the evaluation of information systems can be done in different ways and at different levels, depending on the purpose of the evaluation. The purpose of this information system evaluation is to assess the technical capability, operational implementation, and system utilization [2]. The PIECES Framework and Importance Performance Analysis (IPA) methods are selected in this study as they can translate the opinions of users in the form of questionnaire statements. While the IPA method is used to manage the results of the questionnaire, so that it can produce four quadrants of IPA to know which aspects should be done repair and which should be improved from the RKAT information system. PIECES Framework method is a framework containing the categories of classification and problem-solving problems. The classification is divided into six categories according to the sequence, namely Performance, Information and Data, Economics, Control and Security, Efficiency, and Service. In addition, PIECES has three impetus namely Problem, Opportunity, and Directive [3]. In addition the PIECES Framework method also as a framework used to classify a problem, opportunities, and directives contained in the scope definition of analysis and system design. With this skeleton, it can be generated new things that can be considered in developing the system [4].
Importance Performance Analysis method is applied to measure the level of customer satisfaction and management strategy. The techniques of this method can help to measure the satisfaction of system services and diagnose the shortcomings of the system, as well as to establish priorities in the development of information systems of program plans and subsequent annual activities. Previous research on the implementation of the Importance Performance Analysis method, among others, to understand the level of importance and satisfaction level of the visitors of the zoo [5], help nurses in evaluating the satisfaction service of information systems in hospitals [6] and assess the perception of customers in the use of smartphone applications to 20 hotel network applications [7].
The IPA method can also be implemented with the methods of SWOT analysis (Strengths Weaknesses Opportunities and Threats) in formulating the strategic planning of the Organization so that it becomes more efficient. The SWOT factors that must be maintained or upgraded can clearly be identified as the point of view of the customer [8].

Information System
Information systems are a combination of brainware, hardware, software, communication networks, data sources, rules, and procedures for storing, displaying, changing, and deleting information within an organization [9]. While the information system are also interconnected components and work together to collect, process, store and distribute information to support decision making, coordination, control, analysis and visualization in an organization [10].

PIECES Framework
The PIECES framework method is a framework used to classify a problem, opportunities, and directives contained in the scope definition of analysis and system design, so that it can be generated new things that can be considered in developing the system [11]. In PIECES there are six variables used to analyze the information system, namely: 1) Performance : To know the performance of a system, whether it is running properly or not, this is measured based on the speed, accuracy, and number of findings of the data generated. 2) Information and Data : To know how much and how clear the information will be generated for a single search. 3) Economics : To know the effectiveness of the implementation of the system seen in terms of financial and cost incurred. 4) Control and Security : To determine the extent to which supervision and control is performed in order for the system to run properly. 5) Efficiency : To know the efficiency of the system. 6) Service : To know how the service is done and to know the related problems about the service.

Importance Performance Analysis
Metode Importance Performance Analysis (IPA) ditemukan oleh Martilla dan James pada tahun 1977 sebagai analisis tingkat kepuasan pelanggan terhadap produk atau layanan organisasi. Metode IPA juga digunakan untuk mengukur tingkat kepuasan dan kepentingan pengguna berdasarkan atribut layanan jasa dan produk [12]. Penerapan metode IPA sebagai analisa untuk mengukur tingkat kepuasan pelayanan jasa yang menggambarkan bentuk kuadran-kuadran pada peta importance performance matrix [13]. The Importance Performance Analysis (IPA) technique combines the measurement of factors of importance (expectations) and performance levels (perception) into a twodimensional graphical form that makes it easy to explain data and get practical suggestions [14]. This Plot groups the attributes into four quadrants to set the allocation of limited resources, as shown in Figure 1. accordance with the performance of the user so as to allocate resources to improve performance as expected. b. Quadrant II, the factors found in this quadrant have a high level of importance accompanied by a high level of performance and in accordance with the expectations of the user so that the achievement should be maintained. c. Quadrant III, the factor found in this quadrant has a low level of importance accompanied by a level of performance not too prioritized with relatively low expectations, thus providing too little benefit to the user's perceived. d. Quadrant IV, the factor contained in this quadrant has a low level of importance accompanied by an excessively high degree of performance, so that the university must allocate this quadrant resource to other quadrants requiring improved performance.

Type of Research
This type of research conducted by researchers is a quantitative descriptive that aims to describe, describe the sharing of conditions and situations from various assumptions in the community which is used as an object of research, in this study the object is the Information Systems User [15].

Research Instruments
The research instrument used was a questionnaire as an instrument to obtain information about the level of satisfaction and importance of the information system to users. This questionnaire was made based on 6 variables from PIECES Framework. The object of this research is an information system of annualy work plan and budget at Diponegoro University and the source of primary data or samples is 88 users who have used the system.

Data collection
Data collection was carried out using survey techniques based on the PIECES framework, namely by distributing online questionnaire statements to users of the Diponegoro university's annual program planning and activity program. The Questionnaire is created using the PIECES Framework variable shown in table 1 and 2. 2 Information and Data Data stored by RKAT information system has been stored according to which is inserted into the system. RKAT Information System was not able to store data that was not to supposed. Data that contains errors or incorrect data may be stored by the RKAT information system. The information generated by the RKAT information system is as required.
Information generated by the RKAT information system just in time. The information Format generated by RKAT information system is useful and can be used by users of such systems. Information presented information systems RKAT is easy to learn and understand. Information generated by the RKAT information System are reliable or trustworthy.

Economy
The costs incurred by Diponegoro University became lighter with the information system of RKAT compared to using conventional means.
There are significant changes in terms of development and growth in the presence of information system RKAT.

Control and Security
The form of security contained in the RKAT information system is already able to maintain data or information from various forms of cheating or crime.

No
Variable Statement Management in authorizing and determining access control to the use and operation of the system is obvious.
There is centralized control over data usage.

Efficiency
The system used now further lightens students both in terms of cost and time.
The use of information systems RKAT is very instrumental in the program plan and annual university activities.

Service
The party that handles the system provides assistance to users in the use of information systems RKAT. The RKAT information system is easy to use, learn and understand. The RKAT information system is coordinated and integrates with other systems. The RKAT information System can provide your satisfaction as a user in need of information.

Importance Performance Analysis Method
The process of data analysis using the Importance Performance Analysis (IPA) method is obtained from the questionnaire using the Likert scale [18], which aims to measure the level of satisfaction and interest of the respondents based on the approval of a series of statements given.   (4) Where RK = average satisfaction or importance, JSK = Amount of questionnaire scores, JK = Amount of questionnaires [19].
The Importance Performance Analysis calculation is done in three steps.
Step I : Calculates the level of conformity to determine the magnitude of the user's satisfaction level to the existing service, using the following formula. ( = * + * 100% (1) with ( states the level of conformance from users, declares the value of the average performance assessment, and declares the value of the average user expectation rating.
Step II : Determining the position map of the points of interest and performance, creating a chart that is delimited with two intersecting lines perpendicular, thus forming the four intersecting quadrants at the following points.
where 2 states the average value of expectations or interests, 2 states the average score of perception or performance, and state amount of respondents [20]. Step III : Analyzing all variables that have an influence on the quality of the service by creating graphs of the four quadrants.

Result and Discussion
The results and discussion of the research that has been carried out are based on the research methodology.

Research Instruments
The Research Instrument uses a list of questions that can be seen in table 5.

Data Analysis and Calculation Results
Based on the data analysis and calculation results of the average number of satisfaction and importance using the PIECES framework above that has been collected from 88 respondents obtained data as shown in table 6 and table 7. From this data, an analysis process using the IPA method is then carried out, in order to obtain the results as shown in the fig. 2.  Fig. 2 it can be concluded that the criteria that enter each quadrant based on the PIECES framework can be shown in the table 8.

Satisfaction Conformity Analysis and User Interests
The results of the suitability level analysis to determine the level of satisfaction and importance by applying the Importance Performance Analysis method can be shown in table 9. But there is still a need for improvement and further development to increase user satisfaction and interests in the RKAT information system such as system quality, accurate information, estimated costs to build systems, security systems, efficiency and service improvement for users.