MINISTRY OF EDUCATION AND SCIENCE OF THE PERM KRAI

On approval of the Regulations on the organization of the work of subject commissions during the state final certification for educational programs of secondary general education in the Perm Territory in 2018

In accordance with the Procedure for conducting state final certification for educational programs of secondary general education, approved by Order of the Ministry of Education and Science of the Russian Federation of December 26, 2013 N 1400, I order:

1. Approve the attached Regulations on the organization of the work of subject commissions during the state final certification for educational programs of secondary general education (hereinafter - GIA-11) in the Perm Territory in 2018.

2. Establish that in 2018 subject commissions in general education subjects will check the examination papers of GIA-11 participants in the Perm Territory.

3. The Regional Center for Information Processing (hereinafter referred to as the RCOI) in the organizational and technological support of the activities of the subject commissions in 2018, be guided by this Order.

4. Recognize invalid the Order of the Ministry of Education and Science of the Perm Territory dated February 21, 2017 N SED-26-01-06-203 "On approval of the Regulations on the organization of the work of subject commissions during the state final certification for educational programs of secondary general education in the territory of Perm edge in 2017".

5. The Department of Organizational, Legal and Personnel Work of the Ministry of Education and Science of the Perm Territory publish this Order in the Bulletin of the laws of the Perm Territory, legal acts of the Governor of the Perm Territory, the Government of the Perm Territory, executive bodies of state power of the Perm Territory and post it on the official website of the Ministry of Education and Science of the Perm Territory edges in the information and telecommunication network Internet.

6. To impose control over the execution of the order on the Deputy Minister of Education and Science of the Perm Territory Sidorova L.S.

Minister
R.A.KASSINA

Regulations on the organization of the work of subject commissions during the GIA-11 in the Perm Territory in 2018

APPROVED
by order
Ministry of Education
and Science of the Perm Territory
dated 01/16/2018 N SED-26-01-06-18

This Regulation has been developed in accordance with:

Federal Law of December 29, 2012 N 273-FZ "On Education in the Russian Federation";

Decree of the Government of the Russian Federation of August 31, 2013 N 755 "On the federal information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education, and the admission of citizens to educational organizations for secondary vocational and higher education and regional information systems for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education";

Order of the Ministry of Education and Science of the Russian Federation of December 26, 2013 N 1400 "On approval of the procedure for conducting state final certification for educational programs of secondary general education" (hereinafter - the Procedure);

methodological recommendations on the formation and organization of the work of subject commissions of the constituent entity of the Russian Federation during the state final certification for educational programs of secondary general education, sent by letter of Rosobrnadzor dated December 27, 2017 N 10-870;

decisions of the state examination commission (hereinafter referred to as the SEC).

The Regulation defines the goals of the subject commissions (hereinafter referred to as the PC), their powers and functions, the rights and obligations of members, as well as the procedure for organizing work.

I Introduction

1. List of symbols, abbreviations and terms

Blank protocol	Protocol for checking by an expert the results of completing tasks of an examination paper with a detailed answer
	State final certification for educational programs of secondary general education
	State Examination Commission of the Subject of the Russian Federation
	State final exam
	Unified State Exam
Images of examination papers, samples of examination papers	Images of texts of detailed answers of USE participants used at the stages of preparation and certification of PC experts
Expert qualification	The level of knowledge, skills, abilities (competencies), characterizing the readiness to perform activities for checking tasks with a detailed answer to the exam
Qualification test	Test to establish the level of qualification of an expert of the subject committee
	Control measuring materials
	Conflict Commission of the subject of the Russian Federation
Ministry of Education and Science of Russia	Ministry of Education and Science of the Russian Federation
Educational organization	Organization carrying out educational activities
	The executive authority of the constituent entity of the Russian Federation that carries out state management in the field of education: the Ministry of Education and Science of the Perm Territory
	Subject commission of the subject of the Russian Federation
	Regional information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education
Extended answers	Answers of participants of the Unified State Examination (GVE) to the tasks of the examination work with detailed answers
Rosobrnadzor	Federal Service for Supervision in Education and Science
	Regional information processing center of the subject of the Russian Federation
	Consolidated collection of forms for the Methodological materials for the preparation and conduct of the exam in PES in 2018
Expert status	Confirmed expert qualification level
GIA member	A student admitted in the prescribed manner to the State Academic Examination, a graduate of previous years studying in educational programs of secondary vocational education, a student receiving secondary general education in foreign educational organizations, admitted to passing the Unified State Examination
	FGBNU "Federal Institute of Pedagogical Measurements"
	Federal information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education, and the admission of citizens to educational organizations for secondary vocational and higher education
	The subject commission created by Rosobrnadzor
	Federal State Budgetary Institution "FCT"
	A person included in the administrative document of the OIV in the composition of the PC
	Exam materials

2. General provisions on the activities of the PC

2.1. Verification of the detailed answers of the GIA participants (including oral answers) is carried out by the PC in the relevant academic subjects.

2.2. The PC for each academic subject creates an OIV in accordance with paragraph 14 of the Procedure.

2.3. Candidates for the chairmen of the PCs created in the constituent entities of the Russian Federation are submitted for approval to Rosobrnadzor by the chairman of the SEC within the time limits specified in Appendix 2.

2.4. The formation of the composition of the PC is organized by the chairman of the SEC on the proposal of the chairmen of the PC no later than two weeks before the start of the State Examination.

2.5. The PC in its activities is guided by the regulatory legal acts of the Ministry of Education and Science of Russia, Rosobrnadzor and OIV, including the provisions on subject commissions of the constituent entity of the Russian Federation.

2.6. The SC ceases its activities from the moment the JIU of the SC chairmen is approved for holding the GIA in the constituent entity of the Russian Federation next year.

2.7. The general management and coordination of the activities of the PC in the relevant academic subject is carried out by its chairman. The composition of the PC for each academic subject is formed from persons who meet the following requirements:

1) the presence of higher education;

2) compliance with the qualification requirements specified in the qualification reference books and (or) professional standards;

3) work experience in organizations engaged in educational activities and implementing educational programs of secondary general, secondary vocational or higher education (at least three years);

4) the presence of a document confirming the receipt of additional professional education, which includes practical classes (at least 18 hours) for assessing samples of examination papers in accordance with the assessment criteria for the corresponding academic subject, determined by Rosobrnadzor;

5) the presence of positive results of the qualification test, organized and conducted in the manner prescribed by the OIV.

2.8. The OIV provides PCs with premises for work, which are located in close proximity to the RCOI or in the RCOI. Such premises should exclude the possibility of access to them by unauthorized persons and the dissemination of information of limited access.

2.9. The JIV, on the proposal of the PC chairman, approves a list of additional tools and materials (for example, a non-programmable calculator, dictionaries, etc.) that are acceptable for use by experts in the premises where the PC works during the evaluation of works.

2.10. In the premises where the PCs are located, the OIV provides the placement of a special workplace with access to the information and telecommunications network "Internet" to provide an opportunity to clarify the facts stated in the examination papers of the GIA participants (for example, reconciliation with information from sources, checking the names and names given by the GIA participants , facts, etc.).

2.11. In the premises where PCs are located, there may be:

members of the SEC - by decision of the chairman of the SEC;

citizens accredited as public observers in accordance with the established procedure (hereinafter - public observers), - at will;

officials of Rosobrnadzor, OIV, exercising the transferred powers of the Russian Federation in the field of education - by decision of the relevant authorities.

2.12. Informational, organizational and technological support of the activities of the PC is carried out by the RCOI.

2.13. In the event of situations not covered by these Methodological Recommendations, the appropriate decision is made by the Chairman of the PC and / or the head of the RCOI within their competence with the obligatory subsequent informing of the SEC about the decision taken.

2.14. During the organization and conduct of the exam, the PC checks the detailed answers of the participants in the exam, completed on the answer forms No. 2 (including additional answer forms No. 2), and the oral answers of the participants in the exam in foreign languages.

2.15. During the organization and conduct of the GIA, the distribution of functions between the SC experts is carried out depending on the status assigned to the expert based on the results of the qualification test: leading expert, senior expert, main expert.

2.16. EM processing times.

The processing of the USE and GVE forms, including the PC check of the detailed answers of the GIA participants, must be completed:

1) in the Russian language - no later than six calendar days after the exam;

2) in mathematics (profile level), GVE in mathematics - no later than four calendar days after the exam;

3) in mathematics (basic level) - no later than three calendar days after the exam, checking the detailed answers of the PC is not provided;

4) for other academic subjects - no later than four calendar days after the relevant examination;

5) for exams that are held in the early period and in the reserve period - no later than three calendar days after the relevant exam.

2.17. The organization of video surveillance and video recording in the premises of the PC is provided by the OIV.

2.18. The procedure for the formation of the PC:

Members of the PC during the preparation and conduct of the GIA-11 are required to participate in annual training seminars (consultations), culminating in a qualification test at the federal level "Expert USE". Samples of tasks performed by GIA-11 participants of previous years, which have passed calibration assessment at the federal level, are used as measuring materials.

Based on the results of the qualification test of the SEC of the Perm Territory, a decision is made on admission to the audit and assignment of the category to the expert: leading expert, senior expert or main expert.

The functionality available for an expert is determined by the category assigned to it.

Leading expert - a status that allows you to be the chairman or vice-chairman of the SC, to manage the preparation and / or training of experts at the regional level, to participate in interregional cross-checks, to be involved in the consideration of appeals in the academic subject, to check and recheck the detailed answers of the GIA participants as part of the SC , including as a third expert.

Senior expert - a status that allows you to check and recheck the performance of tasks with a detailed answer of the GIA as part of a PC, including being appointed for the third check of the completion of tasks with a detailed answer of the GIA, to participate in interregional cross-checks, as well as in checks as part of the consideration of an appeal of disagreement with assigned scores.

Main expert - a status that allows you to carry out the first or second check of the tasks with a detailed answer of the GIA, to participate in inter-regional cross-checks as part of the PC.

To assign a particular status to an expert, the correspondence of his qualifications must be established:

requirements for experts defined by the Regulations;

requirements for the experience of evaluating examination papers of GIA participants;

requirements for the results of the qualification test;

the requirements for the consistency of work during the review in the previous year and the values ​​​​of the indicators of statistics of satisfied appeals.

Qualification requirements for establishing categories of experts:

for leading experts: higher education; At least 3 years of experience in education; experience in evaluating examination papers of GIA-11 participants; participation in a seminar for leading experts at the federal level; positive results of qualification tests conducted at the federal level according to uniform measuring materials and uniform requirements for the assessment procedure (in accordance with Appendix No. 1); the absence of negative statistics on the verification of work in the PC and on the results of appeals of the participants of the GIA-11;

(in ed.)

for senior experts: higher education; At least 3 years of experience in education; advanced training on the assessment of examination papers of GIA-11 participants; experience in evaluating examination papers of GIA-11 participants; positive results of qualification tests conducted at the regional level on the basis of measuring materials common for all subjects of the Russian Federation (in accordance with Appendix No. 1), agreed with the leading experts of the Perm Territory, and uniform requirements for the assessment procedure; the absence of negative statistics on the verification of work in the PC and on the results of appeals of the participants of the GIA-11;

(As amended by the Order of the Ministry of Education and Science of the Perm Territory dated April 11, 2018 N SED-26-01-06-316)

for the main experts: higher education, work experience in the education system for at least 3 years, advanced training on the assessment of examination papers of GIA-11 participants, positive results of qualification tests (in accordance with Appendix No. 1) conducted at the regional level on the same basis for all constituent entities of the Russian Federation to measuring materials agreed with the leading experts of the Perm Territory, and uniform requirements for the assessment procedure; the absence of negative statistics on checking work in the PC (for those with experience in the PC).

(As amended by the Order of the Ministry of Education and Science of the Perm Territory dated April 11, 2018 N SED-26-01-06-316)

Use of additional mechanisms for quality control of experts' work:

for leading experts - analysis of the statistics of satisfied appeals, analysis of the consistency of the work of the PC;

for senior experts - analysis of statistics of satisfied appeals, analysis of the consistency of work of PC experts;

for experts - analysis of the consistency of the work of PC experts.

Establishing the procedure for attracting experts to work:

PCs are formed from leading experts, senior experts, main experts:

only experts with the status of a leading expert can be appointed chairmen and deputy chairmen of the SC;

experts who have been assigned the status of "leading expert" or "senior expert" in the current year, who have not previously checked this examination paper, can be appointed to conduct the third check;

to consider appeals of disagreement with the score in the event of controversial questions regarding the assessment of the detailed answer of the GIA-11 participant, only experts who have been assigned the status of "leading expert" or "senior expert" in the current year and have not previously checked this examination work can be involved;

only experts who have been assigned the status of "leading expert" or "senior expert" in the current year can be involved in re-checking the examination papers of participants in the State Examination Institute, initiated by the SEC;

only experts who are members of the commission created by Rosobrnadzor can be involved in rechecking the examination papers of GIA participants initiated by Rosobrnadzor.

3. Qualification requirements for assigning status to experts

3.1. The status of a leading, senior or main expert is assigned to all experts included in the PC (except for the chairman of the PC), depending on the expert's qualification level. The Chairman of the PC is assigned the status of a leading expert without participation in qualification tests.

3.2. To assign a particular status to experts, paragraph 21 of the Procedure establishes:

availability of higher education;

compliance with the qualification requirements specified in the qualification reference books and (or) professional standards;

work experience in organizations engaged in educational activities and implementing educational programs of secondary general, secondary vocational or higher education (at least three years);

the presence of a document confirming the receipt of additional professional education, which includes practical classes (at least 18 hours) for assessing samples of examination papers in accordance with the assessment criteria for the corresponding academic subject, determined by Rosobrnadzor.

3.3. To assign the status of "leading expert" experience in organizational work in a PC or SEC is required. The absence of such experience is allowed in the case when the PC includes less than 10 people. Experts who are not appointed by the Vice-Chairman or the Chairman of the SC and who pass the qualification tests with a result corresponding to the status of "leading expert" are assigned the status of "senior expert".

3.4. The status of "leading expert" and "senior expert" can only be assigned to experts who have experience in evaluating the detailed answers of GIA participants. To be awarded the "leading expert" status, assessment experience must be at least 3 years. The requirements for the experience of evaluating the detailed answers of the GIA participants are established by the OIV. Lack of verification experience is allowed only for newly organized PCs in foreign languages ​​(in cases where a PC in the corresponding academic subject was not previously created in a constituent entity of the Russian Federation).

3.5. The values ​​of the assessment consistency indicators, determined based on the results of qualification tests, must correspond to the values ​​determined by the OIV for assigning experts of each of the statuses. Recommended indicators of consistency and their values ​​based on the results of qualification tests for assigning each of the statuses to experts are given in Appendix 1.

3.6. The methodology for analyzing the consistency of the work of experts and analyzing the statistics of satisfied appeals about disagreement with the points assigned is being developed by the JIU, the minimum list of areas for analyzing the work of the SC is given in Appendix 3. The results of the analysis of the consistency of evaluation are used in the preparation of experts.

3.7. A qualification test for assigning the status to an expert is carried out annually.

3.8. Qualification tests to determine the status of experts in each academic subject are carried out using the Internet system for remote training of experts "Expert EGE" (the selection of works for the creation of measuring materials is carried out by FIPI).

3.9. Experts who have not passed qualification tests in the current year are not allowed to be included in the SC and cannot take part in checking the detailed answers of the GIA participants in the current year.

4. Organization of verification of detailed answers

Methodology for evaluating detailed answers to the tasks of the examination paper

4.1. The detailed answers of the GIA participants are evaluated by two experts.

4.2. According to the results of the first and second checks, the experts independently assign points for each answer to the tasks of the USE examination paper with a detailed answer, for each answer to the tasks of the GVE examination paper. The results of each assessment are entered into the protocol for checking the detailed answers of the GIA participants by the expert.

4.3. In the event of a significant discrepancy in the scores given by the two experts, a third test is scheduled.

4.4. A significant discrepancy in the scores given by the two experts is determined in the assessment criteria for each academic subject.

4.5. The third expert is appointed automatically from among the PC experts who have been assigned the status of "leading expert" or "senior expert" in the current year, who have not previously checked this examination paper.

4.6. The expert who carries out the third check is provided with information about the scores given by the experts who previously checked the examination paper.

4.7. The third expert checks and assigns points for completing all tasks with a detailed answer, the assessment positions for which in the protocol form are not automatically filled in when printing the protocol form.

4.8. The distribution of the works of the USE and GVE participants between the PC experts, the calculation of scores for each task of the USE exam paper with a detailed answer, as well as the determination of the need for verification by a third expert are carried out automatically, using specialized hardware and software tools of the RCOI and FCT.

4.9. The calculation of the final mark for the work of the GVE is carried out by an expert in accordance with the criteria for evaluating the answers to the tasks of the GVE in the relevant academic subject and is recorded in the protocol, which is then transferred to the RCSC for further processing.

4.10. The Chairman of the PC in advance sends information to the EEC about the need to adopt local acts containing a list of technical means and reference materials on paper that are allowed to be used by PC experts in the relevant academic subject.

4.11. Not later than 14 calendar days before the start of EM processing, the PC chairman and the head of the RCOMI will agree on the work schedule of the PC during the period of EM processing in the relevant academic subject, based on the current requirements for the timing of EM processing.

4.12. Not later than 14 calendar days before the start of the examinations, the chairman of the PC transfers to the head of the RCOI the list of the PC and the work schedule of the PC experts for appointing experts to the RIS to check the work.

4.13. The list of the SC, transferred to the head of the RTSOI, must contain information on the status of each member of the SC (main expert, senior expert, leading expert) to ensure the possibility of automated assignment of examination papers for the third check, recheck and verification of appeal papers to experts. The chairman of the PC will coordinate with the head of the RTSOI the work schedule of the PC experts who check the images of the answer forms N 2 supposedly not filled out by the USE participants, additional answer forms N 2.

4.14. Detailed answers of the USE participants, completed only on answer forms No. 2 and additional answer forms No. 2 of the form established by Rosobrnadzor and filled in in accordance with the "Rules for filling out USE forms", are accepted for verification.

4.15. The part of the examination paper that follows after at least one blank page on the USE forms by the USE participant is not allowed for assessment (the tasks, the answers to which are posted on this part of the examination paper, are evaluated as tasks that the USE participant did not start answering, - sign "X").

4.16. Before the start of work, the PC chairman receives from the head of the RCOI the criteria for evaluating detailed answers, as well as additional schemes for evaluating answers when checking answers in foreign languages, received from the FCT on the day of the exam (or the next day after the exam with a significant difference in time of the subject of the Russian Federation with Moscow time), and spends at least 60 minutes promptly coordinating approaches to assessing the detailed answers of USE participants to each of the tasks with a detailed answer, based on the criteria received. It is recommended to reconsider operational assessment approaches after each expert checks the first few papers in order to clarify and concretize the agreed assessment approaches.

4.17. In order to ensure the most coordinated work of the experts, the SC chairman may appoint consultants from among the experts with the status of "leading expert" or "senior expert" who can be contacted by the SC experts in case of difficulties in evaluating the detailed answers of the GIA participants. The workplaces of consulting experts should be organized in the premises where the PC works, so that consultations do not interfere with the work of other experts.

4.18. In order to ensure the most objective assessment of the detailed answers of the State Examination Participants, the chairman of the PC or an expert appointed by him may use specially equipped workplaces in the premises of the PC with access to the Internet information and telecommunication network to enable the experts to clarify the facts presented in the examination papers of the State Examination Papers (for example, verification with sources, verification of surnames, names, facts given by the participants of the GIA, etc.).

4.19. The detailed answers of the GIA participants are checked by the SC experts, guided by the criteria for evaluating the detailed answers and the approaches to assessing the detailed answers agreed in the SC.

4.20. The detailed answers of the GIA participants are evaluated by two SC experts independently. Both experts checking one work, independently of each other, assign points for each detailed answer or for each assessment position (if the answer to the task is evaluated separately for each assessment position) according to the criteria for assessing the performance of tasks with a detailed answer.

4.21. The expert who evaluates the detailed answers of the USE participants is provided with a working kit of the PC expert, which contains:

Impersonal copy forms (form 2-RTSOI) with images of detailed answers of the USE participants (hereinafter referred to as the copy form) - no more than 10 pieces in one working set;

Form protocol (form 3-RTSOI) for checking by an expert the detailed answers of USE participants (hereinafter - the protocol form);

When checking oral answers in foreign languages ​​- a list of works for listening and assessment, generated by means of specialized software, and a form-protocol for checking tasks with an oral answer by an expert (form 3-RTSOI-U).

1) The blank copy is an image of the answer form No. 2 of the USE participant and additional answer forms No. 2, if they were filled out by the USE participant, in the registration part of which are indicated:

Copy blank code;

Information about the expert appointed to check the blank copies of the working set (surname, name, patronymic of the expert, code of the expert);

The date of the exam;

Protocol number and line number in the protocol corresponding to the given code of the copy form;

CMM variant number;

The page number and the number of pages filled out by the USE participant in the answer form N 2, including the additional answer form N 2;

Region code;

Points assigned by two experts who previously checked this work (in the case when the work is sent for the third check).

2) The blank protocol is a table that contains the codes of the blank copies of the received work kit and the fields for the expert to enter points for the answers. The registration part of the protocol form contains:

Information about the expert appointed to check the forms (surname, name, patronymic of the expert, code of the expert);

Name of the subject;

The date of the exam;

Protocol number;

Region code.

4.22. The blank protocol is a machine-readable form and is subject to mandatory automated processing at the RCOI.

4.23. Work kits are formed (printed out) for each expert at the RCOI, taking into account the work schedule of the PC.

4.24. The Chairman of the PC (or his assistant(s) - for large PCs located in several rooms) receives ready-made working sets of experts from the head of the RCSC (or an employee of the RCSC authorized by him).

4.25. Experts check the work of the exam and put points in the appropriate fields of the protocol form in accordance with the criteria for evaluating detailed answers.

4.26. If the expert has difficulty in evaluating the work, the expert may seek advice from the chairman of the SC or a consulting expert appointed by the chairman of the SC.

4.27. The numbers of the most characteristic works that caused difficulties in the evaluation, the expert writes out for transfer to the chairman of the PC.

4.28. After the completion of the verification of the work of each working set, the completed protocol form and copies of the working set are submitted by the chairman of the PC (or his assistant (s) - for large PCs) to the RCSC for further processing. After the automated processing of the forms-protocols in the RCSC, works that require a third check can be identified.

4.29. The work is sent for the third check in case of a significant discrepancy in the scores given by two experts:

1) a significant discrepancy in scores for each academic subject is determined by the assessment criteria and incorporated into the automated processing algorithm;

2) only an expert who has been assigned the status of "leading expert" or "senior expert" in the current year, who has not previously checked this examination paper, who has experience in the first, second and third checks in the current year, can check the work assigned for the third check;

3) on the form-copy of the work scheduled for the third check, in the registration part for the information of the third expert, the points given by two experts who checked this work earlier are indicated. The third expert evaluates according to the assessment items indicated in the protocol form. The assessment positions that the third expert does not check are automatically filled in the protocol when the protocol form is printed.

4.30. During the period of work of the SC, the chairman of the SC and (or) his deputy fixes the numbers of the works that caused the greatest disagreement or difficulties among the experts during the evaluation (based on the works checked by their own hands and (or) works, the numbers of which were written out by the experts in the evaluation process) . Information on the numbers of such works will need to be transferred to FIPI after receiving a corresponding request. These works will be analyzed and used to improve the assessment criteria, conduct training for PC experts and harmonize approaches to assessing examination papers.

4.31. During the period of work of the SC, the chairman of the SC asks the head of the RCSC for statistical information on the progress of checking detailed answers. At the same time, the Chairman of the PC is provided with operational information on the number of works checked at the current time one, two or three times, on the number of works awaiting the first, second or third check, as well as on the number and percentage of works scheduled for the third check, and other information , which allows to determine the quality of PC operation and the need for additional approvals from PC experts. The results of statistical reports are used by the chairman of the PC to optimize the organization of the work of the PC.

4.32. If necessary, the Chairman of the SC gives additional clarifications on the issues of coherence of the work of the SC. The Chairman of the PC sends to the SEC and the JIV a submission on the removal from work of experts who violate the requirements of the Procedure, ignore the agreed approaches to evaluating works during the verification process, systematically make mistakes in evaluating works or violate the verification procedure. The final decision on the issue of removal of an expert from work in the SC is made by the JIU after the consideration of the situation by the SEC.

4.33. When conducting an interregional cross-check, images of the works of USE participants received from another subject of the Russian Federation are checked by PC experts in the general queue of works of USE participants. At the same time, SC members are not provided with information about the works from which subject of the Russian Federation were assigned for verification by SC experts.

4.34. During the period of work of the PC from the moment of receiving the criteria for evaluating detailed answers from the RCOI until the end of the verification of the detailed answers of the GIA participants, all premises in which the PC operates must be provided with a continuous video surveillance and video recording system.

4.35. At the time of leaving the premises of the SC, each member of the SC submits all materials, including the received criteria for evaluating detailed answers, to the person responsible for accounting for copies of the criteria for evaluating detailed answers, appointed by the OIV.

4.36. When an expert reveals cases of violation by an exam participant - the author of an examination paper checked by an expert - of the established Procedure (if it is discovered that the examination paper was performed not independently (for example, it was found that the work was done presumably in different handwriting, tasks of different options were solved, the text of the work coincides with the text in other works and etc.) the expert notifies the PC chairman of the discovered fact. Together with the PC chairman (if necessary, with other experts who discovered the indicated facts) draws up a free-form act indicating the work number and a description of the discovered facts. The PC chairman sends a memo with the application of the specified act to the chairman of the SEC for conducting an internal investigation and making a decision.The expert who discovered such a fact evaluates the work in accordance with the criteria for evaluating detailed (oral) answers, except for the cases specified in the criteria for evaluating detailed (oral) answers and memos e experts.

4.37. Verification of the detailed answers of the GIA participants is considered completed when all the works are checked by the experts the required number of times (determined by the RCOI software), and the assessment results from the protocol forms are analyzed by the RCIU software.

4.38. Upon completion of the work, each SC expert submits all materials, including the received criteria for evaluating detailed answers, to the person who ensures that copies of the evaluation criteria for evaluating detailed answers are recorded, appointed by the OIV.

4.39. Features of checking the detailed answers of the participants of the GVE:

Each GVE work is checked by two experts. When checking the answers of the participants in the exams orally, the experts are given access to a single repository of audio recordings of the answers. The results of checking the work are entered by experts in standardized forms for checking work (see "Detailed form of checking tasks"). Standardized forms for checking work are not machine-readable and are not subject to automated processing.

The experts transfer the initial points of the participants into a mark according to a five-point grading system and make a mark in the first field of the protocol (see "Rules for filling out the protocols of experts of the GVE subject committee"), while the marks "0" and "1" are not used and are not processed.

After filling in the forms of expert protocols, they are processed in the standard mode, similar to the processing of forms.

The final final mark is determined as the arithmetic mean of the two marks given by the experts who checked the work.

The results of checking the work of participants are automatically stored in RIS.

Organization of the work of the PC when rechecking the results of the State Examination

4.40. Until March 1 of the next year, on behalf of Rosobrnadzor or by decision of the SEC, PCs can recheck individual examination papers of GIA participants who passed the GIA on the territory of the Russian Federation or abroad.

4.41. By decision of the OIV, the PC conducts a recheck of individual examination papers of the GIA participants who passed the GIA on the territory of the subject of the Russian Federation. The recheck is carried out by the experts of the PC, who in the current year were assigned the status of "leading expert" or "senior expert", who have not previously checked these works, who have experience in the first, second and third checks in the current year.

4.42. The RCOI enters information about the participants of the State Audit Office, whose works were sent for re-checking by decision of the JIV, into the RIS and forms (prints out) sets of documents for re-checking.

4.43. The set of documents for rechecking contains:

copies of answer forms No. 2, including additional answer forms No. 2;

copies of protocol forms for checking detailed answers;

a recheck protocol form containing an expert opinion on the correctness of evaluating the detailed answers to the tasks of this examination paper;

a variant of KIM performed by a participant in the USE exam;

criteria for evaluating the performance of tasks with a detailed answer of the CIM variant performed by the exam participant.

4.44. The Chairman of the PC receives prepared sets from the head of the RCOI (or an employee of the RCOI authorized by him).

4.45. PC experts carry out a recheck of the received works and fill in the recheck protocol form.

4.46. The completed recheck protocols are submitted by the chairman of the PC to the SEC for approval and to the head of the RCOI (or an employee of the RCOI authorized by him) to enter information on the results of the recheck into the RIS.

4.47. Ensuring that information on the results of the recheck is entered into the RIS with further transfer to the FIS for the purpose of recalculating points is carried out by the RCSC together with the FCT within its competence.

5. Analysis of PC work

5.1. At the end of the GIA and checking the examination papers of the GIA participants, an analysis of the work of the PC is carried out.

5.2. The analysis of the PC operation is carried out in accordance with the procedure for analyzing the operation of the PC (the minimum list of areas for analyzing the operation of the PC is given in Appendix 3).

5.3. The analysis of the work of the PC is carried out on the basis of information provided by the RCOI.

5.4. In order to ensure the analysis of the work of the PC, a group of experts analyzing the work of the PC is provided with access to the CMM in the time and manner established by the OIV.

6. Rules for the chairman, members of the PC, executive secretary of the PC

6.1. Rules for the Chairman of the SC when organizing preparatory events

Preparatory activities to determine the composition and qualifications of PC experts are carried out in accordance with the Procedure, FIPI methodological materials, these Methodological recommendations, normative and methodological materials of the OIV.

PC Chairman:

during the preparation and conduct of the State Exam, has the right to participate in annual federal-level events to improve approaches to assessing the performance of tasks with a detailed answer to the Unified State Examination organized by FIPI;

during the preparation and conduct of the SIA, provides organizational and methodological support for the annual training (training seminars on the coordination of assessment approaches) of experts, taking into account the results of the analysis of the consistency of the work of experts and the statistics of satisfied appeals in previous years;

no later than 14 days prior to the start of processing materials, the SEA on the relevant academic subject forms and agrees with the head of the RCOI the work schedule of PC experts to plan the appointment of experts to check the work;

in the same document indicates the status of each PC expert to ensure automated assignment of work for inspections in accordance with the status of each of the PC experts;

coordinates with the head of the RCSC the work schedule of experts who check the forms recognized as empty.

6.2. Rules for the Chairman of the PC at the stage of checking the detailed answers of the GIA participants

The Chairman of the PC must:

receive a complete set of criteria for evaluating detailed answers from the head of the RCSC, familiarize yourself with the criteria received, prepare for a seminar-harmonization of approaches to evaluation;

ensure that only authorized persons are present in the PC premises. In addition to experts and the chairman of the PC (his assistant - for large PCs), members of the SEC can be in the audience (by decision of the OIV), officials of Rosobrnadzor, the executive authority of the constituent entity of the Russian Federation exercising the transferred powers of the Russian Federation in the field of education (by decision of the relevant authorities) , public observers;

conduct an operational seminar-coordination of approaches to evaluating detailed answers to each of the tasks with a detailed answer (at least 60 minutes long), based on the criteria for evaluating tasks with detailed answers, as well as on the agreed approaches to evaluating detailed answers developed at the federal level ( it is recommended to conduct a second operational coordination of assessment approaches after each expert checks the first few works in order to clarify and concretize the agreed assessment approaches);

get the required number of sets of criteria for experts, as well as additional schemes for evaluating answers when checking answers in foreign languages;

allocate experts to workplaces in the premises allocated for the work of the PC;

give each expert a set of criteria for assessing the performance of tasks with a detailed answer for each option and a working set for verification;

provide advice to experts on the evaluation of examination papers;

public observers;

provide a working atmosphere in the PC;

resolve issues arising from experts within their competence;

to control the quality of filling in the protocol forms by experts and to carry out the prompt exchange of protocol forms and copy forms with the RCOI;

to organize interaction with the head of the RCOMI (an employee of the RCOMI authorized by him) in case the working set was not completely checked by the expert for a number of objective reasons, and to transfer this set with the protocol of verification to the RCOMI;

to transfer to the head of the RCOI (a RCOI employee authorized by him) the blank copies of the entire working set, which has not been completely checked by the expert, for reassignment to other experts;

control the quality of the work of the SC experts, send to the chairman of the SEC and the OIV a submission on the removal from work in the SC of experts who violate the requirements of the Procedure, ignore the agreed approaches to evaluating work during the verification process, systematically make mistakes in evaluating works or violate the verification procedure.

6.3. Rules for the Chairman of the SC at the end of the work of the SC

The Chairman of the PC must:

hand over to the head of the RCOI or a person appointed by the OIV, who ensures that copies of the evaluation criteria for evaluating detailed answers are taken into account, all criteria for evaluating answers to tasks with a detailed answer issued for verification;

upon completion of the check, receive from the head of the RCOI (an employee of the RCOI authorized by him) a package of documents on the results of the work of the PC:

the number of works checked by each expert;

the number of works sent for the third check;

information about the experts who showed the largest number of discrepancies in the evaluation results;

other information related to the activities of the PC, if necessary.

6.4. Rules for the chairman of the PC when considering appeals of disagreement with the points assigned for the GIA

6.4. Rules for the chairman of the PC when considering appeals of disagreement with the points assigned for the GIA.

The Chairman of the PC must:

receive from the chairman of the CC an appeal kit of the GIA participant before the meeting of the CC;

to receive from the head of the RCOI the criteria for assessing the performance of tasks with a detailed answer of the KIM variant, according to which the GIA participant who filed the appeal took the exam, before the meeting of the SC, organize the work of the PC experts to establish the correctness of the assessment of tasks with a detailed and (or) oral answer and (or) about the need changes in points for completing a task with a detailed and (or) oral answer;

to appoint for consideration of the appeal the experts of the PC, who in the current year have been assigned the status of "leading expert" or "senior expert", having experience of the first, second and third inspections in the current year, and transfer the above materials to them;

find out from the responsible secretary of the CC the date, place and time of the CC meeting, as well as the presence at the meeting of the CC to consider appeals of the appellants and (or) their parents (legal representatives);

send the PC experts appointed to consider the appeal and who took part in the work to establish the correctness of the assessment of detailed and (or) oral answers and (or) the need to change the points for completing tasks with a detailed and (or) oral answer of the appellants, to the CC at the meeting of the CC at the specified time (if the appellants and (or) their parents (legal representatives) are present at the meeting of the CC);

transfer to the chairman of the CC the appeal sets of documents and the conclusions of the PC experts after the PC experts have carried out the relevant work to establish the correctness of the assessment of the examination paper on the same day;

promptly transfer to FIPI information about detected incorrect (according to the chairman of the PC) tasks with the obligatory indication of the number of the KIM variant (or KIM number), the number of the task and the content of the remark.

The decision on the correctness of the task and on the change of points for the participants of the GIA who performed it, if the task is recognized as incorrect, is made at the federal level. If the task is recognized as incorrect by all the participants of the GIA who performed this task, the points are recalculated in accordance with the administrative act of Rosobrnadzor.

6.5. Rules for PC Experts

During work, experts are prohibited from:

independently change jobs;

copy and remove from the premises allocated for the work of the PC, copies of examination papers, assessment criteria, forms, protocols for checking examination papers, as well as disclose to unauthorized persons the information contained in these materials;

carry and/or use means of communication, photo, audio and video equipment, portable personal computers (laptops, PDAs and others), except for a workplace specially equipped in the PC premises with access to the information and telecommunications network "Internet" to ensure the possibility clarification by experts of the facts stated in the examination papers of the GIA participants (for example, checking with sources, checking the names, names, facts given by the GIA participants, etc.);

leave the audience without a valid reason;

negotiate, if it is not a consultation with the chairman of the SC or with an expert appointed by the decision of the chairman of the SC as a consultant.

Experts must:

at the preparatory stage, undergo training using the educational and methodological materials of the FIPI and confirm their qualifications in accordance with the requirements of the Procedure, these Methodological Recommendations, as well as the regulatory and methodological documents of the OIV;

be instructed in advance on the content and technology of evaluating detailed answers within the time limits determined by the chairman of the PC;

immediately before checking the work, participate in an operational seminar conducted by the chairman of the PC, coordinating approaches to evaluating detailed answers to each of the tasks with a detailed answer.

Experts who have not confirmed their qualifications and/or have not been instructed and/or do not participate in the operational workshop-coordination are not allowed to check detailed answers.

While checking long answers:

At the direction of the chairman of the PC, take jobs in the provided classrooms;

Obtain work kits for review and evaluation criteria;

Observe discipline during work;

Contact the Chairman of the PC or a person appointed by the Chairman of the PC consultant, if you have any questions or problems in assessing the examination papers;

Fill out the protocol forms, guided by the following rules:

Fill in the fields of the protocol form in block capital letters with a black gel pen strictly inside the fields of the protocol form;

The use of a pencil (even for rough notes), pens with light ink and correction fluid to correct what is written is unacceptable (the presence of a stylus or correction fluid on a scanned form can lead to serious damage to the scanner);

The corrections made must be unambiguously interpreted, all corrections must be recorded and certified by the expert's signature (the corresponding signatures are put at the bottom of the protocol form);

The part of the examination paper that follows after at least one blank page by the GIA participant is evaluated as an answer to the task that the GIA participant did not start to complete (sign "X");

If the GIA participant did not start the task, then in the field (s) in which (s) the score (s) must be entered (s) for completing this task in the protocol form, you should put a sign "X";

If the GIA participant started to complete the task, then in the corresponding field (fields) of the protocol form, the score (points) corresponding to the evaluation criteria should be entered from zero to the maximum possible, specified in the criteria for evaluating the performance of tasks with a detailed answer;

If the USE participant performed an alternative task, then the number of the alternative task chosen by the USE participant should be entered in the appropriate field of the protocol form;

Put the date, sign in the appropriate fields of the protocol form and transfer the working set to the chairman of the PC for submission for processing after completing the completion of the protocol form.

When checking supposedly empty answer forms N 2:

to receive instructions from the head of the RCOI (an RCOI employee appointed by him) and the chairman of the PC on the verification of supposedly empty answer forms No. 2; view from the screen images of supposedly empty answer forms N 2;

if there are entries, signs, drawings or marks on the image that can be regarded as an answer to a task with a detailed answer or confirmation that the USE participant has started the task or had the opportunity to complete it, certify (mark in the software) that the image is completed ;

in the absence of records related to the answer to the tasks, certify (mark in the software) that the image is not filled out.

Images determined by at least one of the checking experts as completed are sent to the PC for verification.

Tasks with detailed answers are counted as tasks that the exam participant did not start, if the images of answer forms No. 2 of this exam participant are determined by two checking experts as blank. In this case, automatically by means of RIS, the answers are evaluated at zero points for completing each task with a detailed answer.

When considering appeals of disagreement with the GIA scores:

receive from the chairman of the PC an appeal set of the GIA participant who filed an appeal, as well as images of the examination paper, a form-protocol for checking assignments by an expert with an oral answer (form 3-RTSOI-U), copies of the protocols for checking the examination paper of the GVE participant and the criteria for evaluating this work;

prior to the meeting of the CC, consider the work of the appellant, as well as analyze the previous evaluation of the work;

give a written opinion on the correctness of the assessment of the appellant's examination paper or on the need to change the points for completing the task with a detailed and (or) oral answer with the obligatory indication of the specific assessment criterion that corresponds to the score they give;

find out from the chairman of the PC the date, place and time of the CC meeting and arrive at the CC at the specified time (in the presence of the appellants and (or) their parents (legal representatives) at the meeting of the CC);

if the appellant or the CC has questions regarding the assessment of detailed answers, provide appropriate explanations. The time recommended for clarifications on the evaluation of detailed and / or oral answers of one appellant is no more than 20 minutes;

in case of detection of errors or incorrect tasks in the CMM, it is necessary to inform the chairman of the PC about this with the obligatory indication of the number of the CMM version, the task number and the content of the remark.

The decision on the correctness of the task and on changing the points for the participants of the GIA in case the task is recognized as incorrect is made at the federal level.

If the task is recognized as incorrect by all the participants of the GIA who performed this task, the points are recalculated in accordance with the administrative act of Rosobrnadzor.

Rules for the responsible secretary of the PC

The executive secretary of the PC is appointed from among the employees of the RCOI or employees involved under a civil law contract.

The executive secretary keeps documentary records of the activities of the PC for each subject:

1. Receives from the head of the RCOMI a register of packages with depersonalized copies for verification.

2. Issues packages and protocols to experts and keeps a record of the packages issued by name in the log for issuing and accepting packages.

3. Accepts packets and protocols from experts after verification and keeps a record of received packets and protocols in the log of issuing and receiving packets.

4. Checks protocols for completeness and correctness of filling.

5. Submits protocols for processing, packages in accordance with the register of received packages to the responsible employee of the RCSC - to the head of the RCSC.

Annex 1. Recommended Score Consistency Metrics for Assessing Experts

Appendix 1

Indicator: the percentage of tasks/assessment criteria for which the expert's assessments did not coincide with the assessments developed during the coordination of approaches to assessing detailed answers.

	The maximum value of the indicator
	Leading expert	senior expert	Key Expert
Russian language Foreign languages Social science Literature
Biology
Informatics and ICT Geography
Mathematics

Appendix 2

Annex 2

	Event
	Preparation of PC experts for the examination of examination papers of the GIA 2018, conducting qualification tests, assigning status to experts of the PC GIA	Until the end of March 2018
	Submission to FIPI of lists of candidates for chairpersons of the PC
	Approval by Rosobrnadzor of candidates for chairpersons of the PC
	PC formation
	FIPI webinars for SC experts of the constituent entities of the Russian Federation to agree on approaches to assessing the detailed answers of GIA participants	May-June 2018 in accordance with the schedule of the exam
	Carrying out prompt coordination of the evaluation of detailed answers in the PC of the constituent entities of the Russian Federation	After receiving the criteria for evaluating detailed answers
	Selection of examination papers of USE participants that caused difficulties in assessment for inclusion in the FIPI educational and methodological materials	In the process of checking work
	Analysis of PC operation	July 2018
	Sending to FIPI information about the numbers of works that caused difficulties in evaluating	July 2018
	Carrying out CPC on AVE programs for the training of experts (24.0)	February 2018

Appendix 3. The minimum list of areas for analyzing the work of the PC

Annex 3

The analysis of the work of the PC is carried out in order to optimize the work of the PC to check the detailed answers of the GIA participants, its maximum objectivity, the development of uniform requirements and approaches to evaluating examination papers that minimize the subjectivity of the reviewing experts.

When analyzing the operation of a PC, it is necessary to pay attention to the following areas of PC activity:

1. Conditions for the inspection:

location of the PC in/outside the RCOI building, the number of buildings, rooms where the PC is located;

the number of audiences during the work of the PC;

carrying out operational coordination of approaches to the evaluation of detailed answers on the day the evaluation criteria were received before the start of the verification (whether it was carried out, duration, whether there was a need for additional coordination during the verification process);

the work of expert consultants appointed by the chairman of the PC during the work of the PC, their number, the principle of distribution by premises, the scope of consulting (consultation of experts located in the same room / auditorium; consultation on evaluating answers to certain tasks, etc.);

the presence of a workplace specially equipped in the premises of the PC with access to the information and telecommunication network "Internet" to enable the experts to clarify the facts stated in the examination papers of the SIA participants; the demand for this job;

other (in case of detection of conditions that significantly affect the quality of the PC).

2. The number and proportion of PC experts with the status of leading, senior, main expert.

3. Qualification of experts (compliance with the requirements of the Procedure, the number of experts whose qualifications do not meet the requirements of the Procedure, the reasons for including such experts in the PC).

4. The total number of checks carried out by the PC (separately checks by the first and second experts, third checks, checks of appeal papers, rechecks by decision of the JIV).

5. The total number of SC experts involved in the verification of works at different stages of the GIA (early, main and additional).

6. The total number of PC experts involved in the verification of appeal papers. The principle of selection of experts involved in the consideration of appeals.

7. Statistics of consideration of appeals of disagreement with the scores for detailed answers (total number of appeals filed, the number of satisfied appeals regarding the change in scores for detailed answers, the number of works with reduced results on appeals, increased results on appeals, minimum and maximum change in points, main reasons for the appeal).

8. Total number of experts who carried out the third check.

9. The share of works sent for the third check after the check in the PC, i.e. excluding empty works (average for the entire commission).

10. The maximum and minimum value of the individual indicators of experts "the share of works sent for the third review".

11. Maximum and minimum number of works checked by one expert.

12. The list of experts who regularly (more than 5% of the checked works) allow significant discrepancies in the assessment of the scores given by other experts:

cases of significant difference between the sum of points of the first and second experts; analysis of the situation, identified causes, decisions made (training, changing the functionality within the framework of the PC, exclusion from the PC, etc.);

Example 1

N assessment positions

Sum of points

Expert 1

Expert 2

In the given example, the difference between the scores given by the experts is 17 - 6 = 11 points. The situation indicates a clear disagreement in the work of the PC experts. It is necessary to identify the consistency of this situation for each of the experts of the pair, the reasons.

Example 2

N assessment positions

Sum of points

Expert 1

Expert 2

Expert 3

In the above example, there is no difference between the sums of points given by the experts: all 3 experts gave a total of 11 points. Nevertheless, the situation of discrepancy in assessment is obvious: Expert 2 gave points that for each individual position of assessment differ from the points given by Expert 1 (16 points) and Expert 3 (16 points). With regard to the results of evaluation by Expert 1 and Expert 3, we can say that these results differ by 1 point only in two positions of evaluation out of 12, which indicates the support of these experts for unified approaches to the evaluation of works.

cases of a significant difference in the points given for each assessment position; analysis of the situation, identified causes, decisions made (training, changing the functionality within the framework of the PC, exclusion from the PC, etc.);

Example 3

N assessment positions

Sum of points

Expert 1

Expert 2

Appeals expert

In the example above, the experts came up with a very consistent result during the review. However, on appeal, the score is changed by 7 primary points relative to the final score based on the results of the evaluation of two experts. Obviously, either the situation of inconsistency of approaches to evaluation by the expert who checked the work on appeal, or the presence of procedural violations or the interest of this expert.

other cases of disagreement in the work of experts, their description, quantitative indicators; analysis of the situation, identified causes, decisions made (training, changing the functionality within the framework of the PC, exclusion from the PC, etc.).

13. The planned number of SC experts in the next year, the planned number of experts entitled to carry out the third check, recheck, review of appeal papers (experts with the status of a senior or leading expert), expected indicators of the consistency of work of experts for assigning a status to SC experts during qualification tests .

14. Planned changes in the processes of training experts, the formation of the PC, the organization of the procedure for evaluating works in relation to the previous year.

15. Main conclusions.

A three-level system for coordinating assessment approaches Coordination at the FU 1) Uniform assessment criteria 2) Training of leading experts within the framework of the FIPI SC 3) Coordination of the positions of the SC chairmen (FIPI seminars) Coordination at the RU 1) Training of SC members by leading experts 2) Use of UMM developed by FIPI 3) Selection based on review consistency analysis Operational coordination 1) Discussing assessment criteria on the day of the exam (agreeing on approaches) 2) Consulting during the review

1. Conducting training, including practice and harmonization of approaches to assessment at the regional level under the guidance of the SC chairman 2. Conducting a qualification test, assigning statuses to experts: senior, main Those who did not pass the qualification test are not included in the SC consistency of the work of the commission and each expert separately, incl. in the process of verification Formation of PC in the subjects of the Russian Federation

Statuses of SC experts Leading expert status that allows to be the chairman or vice-chairman of the SC, to supervise the preparation and / or training of experts at the regional level, to participate in interregional cross-checks, to be involved in the consideration of appeals in the academic subject, to check and recheck the detailed answers of the GIA participants in as part of the PC, including as a third expert Senior expert status that allows to check and recheck the performance of tasks with a detailed answer of the GIA as part of a PC, including being appointed for the third check of the performance of tasks with a detailed answer of the GIA, to participate in interregional cross-checks, and also in checks as part of the consideration of an appeal of disagreement with the points given. Main expert status, which allows to carry out the first or second check of the fulfillment of tasks with a detailed answer of the GIA, to participate in inter-regional cross-checks as part of the PC

Preparatory stage of the work of the PC Chairman of the PC selection of expert candidates for inclusion in the composition of the PC (hereinafter referred to as expert candidates), expert candidates must comply with the requirements of the current regulatory framework; Familiarization of the Chairman of the PC with the documentation containing statistical and analytical information on the conduct and processing / verification of materials from the previous season of the GIA; Familiarization of the chairman of the PC and expert candidates with the specifications and demo versions of the examination materials of the GIA, which are planned to be used during the GIA; Participation of the chairman of the PC and expert candidates in the events of the regional and federal levels on the organization, formation and work of the PC, harmonization of approaches to assessment;

Preparatory stage of work of the PC Determination by the chairman of the PC of the procedure for conducting qualification tests for expert candidates, determination of threshold values ​​for the results of qualification tests for expert candidates; Conducting introductory seminars by the chairman of the PC, as well as seminars on harmonizing approaches to assessing examination papers; Carrying out qualification tests by the chairman of the PC for expert candidates for inclusion in the PC, establishing statuses for each expert included in the PC; Submission by the Chairman of the PC of the lists of experts included in the PC to the JIV for approval; formation and coordination by the chairman of the SC with the head of the RCSC of the work schedule of experts with an indication of their status for the correct distribution of work among the experts of the SC.

With methodological materials of Rosobrnadzor on the formation and organization of the work of subject commissions; with a schedule (an appendix to methodological materials); under the guidance of leading experts, in accordance with unified approaches to assessment, agreed upon at face-to-face seminars at FIPI; using sets of manuals (Educational and methodological materials for chairmen and members of regional subject commissions for checking assignments with a detailed answer to exam papers of the USE). Activities for the training of experts in the constituent entities of the Russian Federation are carried out in accordance with:

Informational and organizational and technological support of the activities of the PC is carried out by the RCOI The chairman of the PC agrees with the head of the RCOI on the work schedule of the PC experts who check the blank answer forms 2, additional answer forms 2 that are not completed by the participants of the Unified State Examination, the general management and coordination of the activities of the PC in the corresponding academic subject is carried out by its chairman Organization of the work of the PC

Subject commissions work in premises that exclude the possibility of access to them by unauthorized persons and the dissemination of information of limited access. The following persons are present at the RCI and PC premises: o Members of the SEC - by decision of the chairman of the SEC o Public observers o Officials of Rosobrnadzor o Authorized representatives of the EEC of a constituent entity of the Russian Federation

Organization of the work of the PC during the period of the test Carrying out operational coordination of approaches to the assessment of examination papers within the PC, based on previously developed approaches, taking into account the specifics of the tasks proposed to the participants of the State Examination at the exam. Selection of blank answer forms by 2 SC experts to be excluded from the array of works checked by the SC. Direct verification of the detailed answers of the GIA participants by the PC experts

Rules for experts It is forbidden to: copy and take out examination papers, assessment criteria, verification protocols disclose to unauthorized persons the information contained in the materials carry communication equipment, photo, video and audio equipment expert from the subject committee

The distribution of the work of the USE participants among the PC experts, the calculation of scores for each task of the USE exam paper with a detailed answer, as well as the determination of the need for verification by a third expert are carried out automatically, using specialized hardware and software tools of the RTSOI The third expert checks and assigns points for completing all tasks with a detailed answer, the assessment positions for which in the protocol form are not filled with the “X” sign

Methodology for evaluating the detailed answers of the examination papers of the USE participants The detailed answers of the USE participants, completed only on answer forms 2 and additional answer forms 2, established by Rosobrnadzor, are accepted for verification. The detailed answers of the GIA participants are evaluated by two PC experts independently. Both experts checking one work independently assign points for each detailed answer or for each assessment position (if the answer to the task is evaluated separately for each assessment position) according to the criteria for assessing the performance of tasks with a detailed answer

The working set of the PC expert when evaluating detailed answers contains: depersonalized copy forms (form 2-RTSOI) with images of the detailed answers of participants in the USE participant (hereinafter referred to as the copy form) - no more than 20 pieces in one working set depersonalized copy forms (form 2 -RTSOI) with images of the detailed answers of the participants of the USE participant (hereinafter referred to as the copy form) - no more than 20 pieces in one working set of the protocol form (form 3-RTSOI) of the examination by the expert of the detailed answers of the USE participants (hereinafter - the protocol form); when checking oral answers in foreign languages: a list of works for listening and assessment, generated using specialized software and a machine-readable protocol for checking oral answers

The method for evaluating the detailed answers of the exam papers of the USE participants The verification of the detailed answers of the GIA participants is considered completed when the results of the assessment from the protocol forms are analyzed by the RTSOI software, all the works were checked by experts the required number of times

Introduction of an expert consulting system (singling out a separate category of experts who advise other experts in case of difficulties in evaluating works) Monitoring of the verification process by the chairman (operational report from the RCOI) Organization of a separate workplace with the possibility of accessing the Internet ("hot line", forum on the FIPI website) Organization of PC work

The first-second checks The third check if there is a significant discrepancy in the assessment during 1-2 checks Carrying out interregional cross-checks Checking the oral answers of exam participants During the main processing and checking of USE papers Checks when considering appeals Selective rechecks of the regional and federal levels Types of checks carried out by subject commissions subjects of the Russian Federation

Not a member of the conflict commission (only involved in the consideration of the appeal) Not an expert who previously reviewed the work of this appellant Has the status of a senior or leading expert in the PC Carried out the first or second checks of examination papers during the main test in the current year Requirements for the PC expert involved in the review Appeals Checks on Appeals

Evaluates the detailed answers of the appeal work Is present during the consideration of the appeal Provides explanations to the appellant or his legal representative on the essence of the evaluation of any tasks (if questions arise): detailed answers The functions of the PC expert when considering appeals Checks when considering appeals The QC applies to FIPI with a request for clarification on the criteria evaluation (if the involved PC experts do not give an unambiguous answer about the correctness of the assessment of the appellant's examination work)

Section from the regional report recommended by FIPI 1) Analysis of the work of the subject commission for checking tasks with a detailed answer: o consistency of the check (in 2015 and dynamics over the past 3 years) o typical difficulties in assessing o statistics of satisfied appeals 2) Recommendations for improving the work of regional subject committees Selection of experts to work in the PC Additions to the methodological materials for the preparation of experts Appointment of senior experts Analysis of the work of the subject committees of the USE-2015

Letter of the Federal Service for Supervision in Education and Science dated March 11, 2014 N 02-97 On Guidelines for the development of a regulation on the state examination commission of a constituent entity of the Russian Federation for conducting state final certification in educational programs of secondary general education and Guidelines for the formation and organization work of subject commissions of the subject of the Russian Federation

The Federal Service for Supervision in Education and Science sends for use in the development of regulations on the state examination commission of the constituent entity of the Russian Federation for conducting state final certification in educational programs of secondary general education and for the formation and organization of the work of subject commissions of the constituent entity of the Russian Federation.

Application for: 36 l.

S.S. Kravtsov

Guidelines
on the development of regulations on the state examination commission of the constituent entity of the Russian Federation for conducting state final certification for educational programs of secondary general education

The Regulations on the State Examination Commission of a Subject of the Russian Federation for Conducting State Final Attestation in Educational Programs of Secondary General Education (hereinafter referred to as the Regulations on the SEC) are developed on the basis of the Procedure for Conducting State Final Attestation in Educational Programs of Secondary General Education, approved by order of the Ministry of Education and Science of the Russian Federation dated 26.12.2013 N 1400 (registered by the Ministry of Justice of the Russian Federation on 03.02.2014, registration N 31205), taking into account these Recommendations and approved by the executive authority of the constituent entity of the Russian Federation, exercising public administration in the field of education.

The Regulation on the SEC defines the goals, procedure for the formation and structure of the state examination commission of a constituent entity of the Russian Federation (hereinafter referred to as the SEC), its powers and functions, as well as the procedure for organizing the work of the SEC. It is recommended that the structure of the SEC and the distribution of powers and functions be specified taking into account the specifics of the scheme for conducting state final certification for educational programs of secondary general education (hereinafter referred to as the GIA, USE), implemented in the constituent entity of the Russian Federation.

1. General Provisions

The GEC is created in order to:

organization and coordination of work on the preparation and conduct of the GIA;

ensuring that the rights of GIA participants are observed during the GIA.

The GEC in its work is guided by:

Federal Law No. 273-FZ of December 29, 2012 "On Education in the Russian Federation";

Decree of the Government of the Russian Federation of August 31, 2013 N 755 "On the federal information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education, and the admission of citizens to educational organizations for secondary vocational and higher education and regional information systems ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education";

The procedure for conducting state final certification for educational programs of secondary general education, approved by order of the Ministry of Education and Science of the Russian Federation of December 26, 2013 N 1400 (registered by the Ministry of Justice of the Russian Federation on February 3, 2014, registration N 31205) (hereinafter referred to as the Procedure);

The procedure for admission to study in educational programs of higher education - bachelor's programs, specialist's programs, master's programs for the 2014/15 academic year, approved by order of the Ministry of Education and Science of the Russian Federation dated January 9, 2014 N 3 (registered by the Ministry of Justice of Russia on February 19, 2014, registration N 31352 );

regulatory legal acts and instructive documents of the constituent entity of the Russian Federation on the organization and conduct of the GIA in the constituent entity of the Russian Federation;

individual legal acts and instructive and methodological documents of Rosobrnadzor on the organizational and technological support of the State Audit Inspectorate;

other regulatory legal acts on the organization and conduct of the GIA.

2. Composition and structure of HES

The executive authority of the constituent entity of the Russian Federation, which carries out state administration in the field of education, annually sends to Rosobrnadzor a proposal for the candidacy of the chairman of the SEC for approval, as well as proposals for approving the composition of the SEC for approval.

The composition of the SEC is formed from among representatives of the executive authorities of the constituent entities of the Russian Federation exercising state administration in the field of education, executive authorities of the constituent entities of the Russian Federation exercising delegated powers in the field of education, local governments, organizations engaged in educational activities, scientific, public and other organizations and associations, representatives of Rosobrnadzor. When forming the composition of the SEC, it is necessary to exclude the possibility of a conflict of interest.

When forming the personal composition of the SEC, it is recommended to determine the deputy chairman of the SEC and the executive secretary. It is also recommended to form the presidium of the SEC consisting of no more than 20 people. Persons who are members of the Presidium of the SEC are vested with the authority of collective decision-making in accordance with the Procedure.

The regulation on the SEC of a constituent entity of the Russian Federation is brought to the attention of the participants of the State Examination, entering, their parents (legal representatives), heads of educational organizations no later than 1 month before the start of the State Examination.

3. Powers and functions of the SEC

3.1. The SEC operates during the period of preparation, conduct, and summarizing the results of the GIA in the constituent entity of the Russian Federation.

The term of office of the SEC is one year. The SEC ceases its activities from the moment the Rosobrnadzor approves the chairman of the SEC and agrees on the composition of the SEC for conducting a GIA in a constituent entity of the Russian Federation next year.

3.2. The SEC, when organizing and coordinating work on the preparation and conduct of the GIA, performs the following tasks:

organizes and coordinates the work on the preparation and conduct of the GIA on the territory of the subject of the Russian Federation;

ensures compliance with the established procedure for conducting the GIA on the territory of the subject of the Russian Federation;

ensures the observance of the rights of students and graduates of previous years during the GIA;

3.3. As part of the preparation and conduct of the GIA, the SEC carries out the following work:

determines and organizes the work of persons sent by organizations engaged in educational activities to work as leaders and organizers of the PES, members of the SEC, technical specialists and assistants for the persons specified in paragraph 37 of the Procedure;

organizes control over the work of organizations engaged in educational activities, in terms of informing students and their parents (legal representatives), graduates of previous years about the dates, places and procedure for applying for the GIA, including in the form of the Unified State Examination, about the place and timing of the GIA , on the procedure for conducting the GIA, including the grounds for removing from the exam, changing or canceling the results of the GIA, on maintaining video recording during the exam in the PES and classrooms, on the procedure for filing and considering appeals, on the time and place of familiarization with the results of the GIA, and also about the results of the GIA received by a student, a graduate of previous years;

decides on equipping the PES with mobile communication signal suppression systems;

decides on the implementation of the RCSC of the automated distribution of students, graduates of previous years and organizers by audience;

makes a decision to conduct replication of KIM in classrooms in the presence of students, graduates of previous years;

decides on the scanning of examination papers in the PES classrooms;

collects forms, comments on violations of the procedure for conducting the GIA, sent by the participants of the GIA, and carries out the relevant work;

accepts and considers the protocols of the subject commissions on the distribution of examination papers of the GVE, the calculation of the final points of the examination work of the GVE;

considers proposals on the composition of the subject commission, on the candidacies of experts proposed for inclusion in the subject commissions created by Rosobrnadzor;

considers information from the conflict commission on the decisions made on students, graduates of previous years and (or) their parents (legal representatives) who filed appeals;

in order for the Chairman of the SEC to make a decision to cancel the result of the State Examination in connection with a violation of the established procedure for conducting it, requests from authorized persons and organizations the necessary documents and information, including examination papers, information about the persons present at the PES, and other information on compliance with the procedure for conducting the State Examination , conducts an inspection on the facts of violation of the established procedure for conducting the SIA, including on violations identified with the help of video surveillance materials;

makes a decision to familiarize students, graduates of previous years with the results of the State Academic Examination obtained by them in the academic subject using information and communication technologies in accordance with the requirements of the legislation of the Russian Federation in the field of personal data protection;

decides on filing and (or) consideration of appeals using information and communication technologies, subject to the requirements of the legislation of the Russian Federation in the field of information protection;

performs other functions in accordance with the Regulations on the SEC.

3.3.1. As part of the preparation and conduct of the GIA, the chairman of the SEC carries out the following work:

organizes the formation of the composition of the SEC and submits it for approval to Rosobrnadzor;

coordinates the proposals of the executive authority of the constituent entity of the Russian Federation, exercising public administration in the field of education:

on the personal composition of the leaders and organizers of the PES;

for technical specialists and assistants for people with disabilities, children with disabilities and people with disabilities, people who studied at home for health reasons, in educational organizations, including sanatoriums and resorts, in which the necessary medical, rehabilitation and recreational activities are carried out, for those in need of long-term treatment;

at the places of registration for the exam;

according to the locations of PES and the distribution between them of students and graduates of previous years;

organizes the formation of the composition of subject commissions, submits for approval to Rosobrnadzor candidacies of chairmen of subject commissions, on the recommendation of the chairmen of subject commissions, determines candidates for members of subject commissions sent for inclusion in the subject commissions created by Rosobrnadzor;

makes a decision on sending members of the SEC to the PES, RCOI, subject commissions and the conflict commission to monitor the conduct of the State Examination;

considers issues of the occurrence of a conflict of interest in relation to persons involved in the conduct of the State Examination, takes measures to prevent the occurrence of a conflict of interest, including making a decision on the removal of these persons from work related to the conduct of the State Examination;

makes a decision to conduct the GIA in compulsory academic subjects ahead of schedule for the categories of students, graduates of previous years in accordance with the Procedure;

agrees on the decision of the SEC members to stop the exam in the PES or individual PES classrooms;

considers and makes decisions on the acts submitted by the members of the SEC, upon the fact of a malfunction, disconnection of video surveillance equipment or the absence of a video recording of the exam;

3.3.2. As part of the preparation and conduct of the GIA, the members of the SEC carry out the following work:

ensure compliance with the established procedure for conducting the GIA;

ensure the delivery of examination materials to the PES;

in the case of using KIM on electronic media in encrypted form, they are present and control the process of receiving the decryption code of KIM from the RCOI by the head of the PES, organizing the decoding, replication on paper of KIM and packaging of examination materials for the exam;

exercise control over the conduct of the State Examination in the PES, RTsOI, subject commissions and the conflict commission;

draw up acts of removal from the exam and remove persons who have violated the established procedure for conducting the GIA from the PES, acts on the early completion of the exam by the GIA participant for objective reasons, these acts are sent on the same day to the State Examination Board and the RCSC for accounting when processing examination papers;

draw up acts on the fact of a malfunction, disconnection of video surveillance equipment or the absence of a video recording of the exam, these acts are transferred to the chairman of the SEC on the same day;

upon completion of the exam, they draw up a report on the USE in the PES and send it to the SEC on the same day.

on the same day, the examination papers of the Unified State Examination of students, graduates of previous years from the PES are delivered to the RCOI, and the examination papers of the GVE are delivered to the places determined by the executive authority of the constituent entity of the Russian Federation, which carries out state administration in the field of education;

when scanning examination papers directly in the classrooms, if such a decision is made by the SEC, members of the SEC monitor the scanning of examination papers in the classrooms in the presence of students, graduates of previous years and transfer scanned images of the examination papers to the RTSOI, an authorized organization for further processing;

interact with the head and organizers of the PES, public observers, officials of Rosobrnadzor, the executive authority of the constituent entity of the Russian Federation exercising the delegated powers of the Russian Federation in the field of education, present in the PES, RTsOI, subject commissions and the conflict commission on compliance with the established procedure for conducting the GIA;

in case of detection of violations of the established procedure for conducting the GIA, they decide to remove students, graduates of previous years, as well as other persons who are in the PES from the exam;

in agreement with the chairman of the SEC, they decide to stop the exam in the PES or individual classrooms of the PES.

3.4. As part of the consideration of the results of the GIA, the chairman of the SEC carries out the following work:

considers the results of the GIA and makes decisions on the approval, change and (or) cancellation of the results of the GIA

makes decisions on admission (re-admission) to the delivery of the GIA in cases established by the Procedure.

3.5. The SEC carries out its activities in cooperation with state educational authorities at various levels, the council of university rectors, educational organizations, the Russian Center for Education and Science, and the Federal State Budgetary Institution "Federal Testing Center".

The SEC interacts with public observers, federal public observers and federal inspectors in order to ensure control over compliance with the established procedure for conducting the GIA.

4. Powers of the chairman, deputy chairman, executive secretary and members of the SEC

The Chairman of the SEC, approved by Rosobrnadzor, carries out general management of the work of the SEC, determines the work plan of the SEC, distributes duties among the members of the SEC, conducts meetings of the SEC, approves the working documentation, and controls the implementation of the decisions of the SEC. The Chairman of the SEC is personally responsible for the decisions made.

The Deputy Chairman of the SEC ensures the coordination of the work of the members of the SEC, subcommittees, prepares draft documents submitted for consideration by the SEC, and monitors the implementation of the SEC work plan.

The executive secretary of the SEC keeps minutes of the meetings of the SEC, organizes the clerical work of the SEC, monitors the timely submission of materials for consideration at the meetings of the SEC, is responsible for the safety of documents and other materials considered at the meetings of the SEC.

The chairman, his deputy, members of the SEC are responsible for the compliance of the activities of the SEC with the requirements of legislative and other regulatory legal acts.

5. Organization of the work of the SEC

The SEC holds its meetings in accordance with the work schedule approved by the Chairman of the SEC. If necessary, the chairman of the SEC may appoint an extraordinary meeting of the SEC.

Decisions of the SEC are made by a simple majority vote of the SEC Presidium. In case of equality of votes, the vote of the chairman of the SEC is decisive. The decisions of the SEC, including the sole decision of the chairman of the SEC, are documented in protocols, which are signed by the chairman of the SEC, the deputy chairman of the SEC and the executive secretary of the SEC.

The decisions of the SEC within the scope of authority are binding on all organizations, educational organizations and persons involved in the preparation and conduct of the State Audit Office. The organization of the execution of decisions of the SEC is ensured by the administrative acts of the executive authority of the constituent entity of the Russian Federation, which carries out state administration in the field of education.

Based on the results of the work of the SEC in the current year, a certificate is being prepared on the conduct of the State Examination in the constituent entity of the Russian Federation, including information on the composition of participants, the results of the State Examination, and the problems that have occurred. The certificate is signed by the chairman of the SEC, the deputy chairman of the SEC and sent to the executive authority of the subject of the Russian Federation, which carries out state administration in the field of education, and Rosobrnadzor.

______________________________

* a conflict of interest is understood as a situation in which the personal interest of the person involved in the GIA, or his close relatives, affects or may affect the objective performance of the duties assigned to him and in which a conflict arises or may arise between the personal interest of this person and the legitimate interests of students , their parents (legal representatives), other interested parties, which can lead to harm to these legitimate interests of students, their parents (legal representatives), other interested parties

Methodical materials
on the formation and organization of the work of subject commissions

List of symbols, abbreviations and terms

ATE	Administrative-territorial unit
DB	Database
GIA	State final certification for educational programs of secondary general education
HEC	State Examination Commission of the Subject of the Russian Federation
USE	Unified State Exam
ERBD	Single distributed database
ZSPD	Closed data network
IR	Individual set of the USE participant
Images of examination papers, samples of examination papers	Images of texts of detailed answers of USE participants used at the stages of preparation and certification of PC experts
Expert qualification	The level of knowledge, skills, abilities (competencies), characterizing the readiness to perform activities for checking tasks with a detailed answer to the exam
Qualification test	Test to establish the level of expertise of an expert
KIM	Reference measuring material
QC	Mediation board
Machine-readable PES forms	Forms PPE-13-02, PPE-18 (see Consolidated collection of forms for Methodological materials for preparing and conducting the exam at exam points in 2014)
Ministry of Education and Science of Russia	Ministry of Education and Science of the Russian Federation
MOUO	Local self-government body exercising powers in the field of education
Educational organization	Organization carrying out educational activities
HIA	USE participants with disabilities
OIV	Executive authority of the constituent entity of the Russian Federation exercising state administration in the field of education
PC	Subject commission of the subject of the Russian Federation
The procedure for conducting the GIA	The procedure for conducting the state final certification for educational programs of secondary general education, approved by order of the Ministry of Education and Science of the Russian Federation of December 26, 2013 N 1400 (registered by the Ministry of Justice of Russia on February 03, 2014, registration N 31205)
PES	Point of holding a unified state exam
Rules for the formation and maintenance of FIS/RIS	Rules for the formation and maintenance of the federal information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education, and the admission of citizens to educational organizations for obtaining secondary vocational and higher education and regional information systems for ensuring the state final certification of students who have mastered the main educational programs of basic general and secondary general education, approved by the Decree of the Government of the Russian Federation of August 31, 2013 N 755
RICE	Regional information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education
Extended answers	Answers of the exam participants to the tasks of the examination paper with detailed answers
Rosobrnadzor	Federal Service for Supervision in Education and Science
RF	the Russian Federation
RCOI	Regional Information Processing Center
SbF	Consolidated collection of forms to the Methodological materials for the preparation and conduct of the exam at the examination points in 2014
Expert status	Confirmed expert qualification level
USE participant/exam participant/participant	Students admitted in the prescribed manner to the state final certification for educational programs of secondary general education in the form of the Unified State Examination, graduates of previous years admitted to passing the Unified State Examination
Member of the SEC	Representative of the state examination commission of the constituent entity of the Russian Federation
FIPI	FGBNU "Federal Institute of Pedagogical Measurements"
FIS	Federal information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education, and the admission of citizens to educational organizations for secondary vocational and higher education
FPC	Federal Subject Commission. The subject commission created by Rosobrnadzor
FCT	FSBI "Federal Testing Center"
Experts	Persons who meet the following requirements: - compliance with the qualification requirements specified in the qualification reference books and (or) professional standards; - work experience in organizations engaged in educational activities and implementing educational programs of secondary general, secondary vocational or higher education (at least three years); - the presence of a document confirming the receipt of additional professional education, which includes practical classes (at least 18 hours) for assessing samples of examination papers in accordance with the assessment criteria for the relevant academic subject, determined by Rosobrnadzor.
EM	Exam materials

* Part 14 of Article 59 of the Federal Law of December 29, 2012 N 273-FZ "On Education in the Russian Federation" (Collected Legislation of the Russian Federation, 2012, N 53, Art. 7598; 2013, N 19, Art. 2326; N 30 , item 4036).

Introduction

This document has been developed in accordance with the following regulatory legal acts for the preparation and conduct of the exam:

1. Federal Law of December 29, 2012 N 273-FZ "On Education in the Russian Federation";

2. Decree of the Government of the Russian Federation of August 31, 2013 N 755 "On the federal information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education, and the admission of citizens to educational organizations to receive secondary vocational and higher education and regional information systems for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education";

3. Order of the Ministry of Education and Science of the Russian Federation of December 26, 2013 N 1400 "On Approval of the Procedure for Conducting State Final Attestation in Educational Programs of Secondary General Education".

I. General provisions on the activities of subject commissions

1.1. Verification of detailed answers of USE participants is carried out by subject commissions (hereinafter - PC) in the relevant academic subjects.

1.2. The PC of the constituent entity of the Russian Federation for each academic subject creates the OIV in accordance with clause 14 of the Procedure for conducting the State Examination.

1.3. The PC in its activities is guided by the regulatory legal acts of the Ministry of Education and Science of Russia, Rosobrnadzor and OIV, including the "Regulations on subject commissions of the subject of the Russian Federation."

1.4. The general management and coordination of the activities of the PC in the relevant academic subject is carried out by its chairman, including submitting proposals to the SEC on the composition of the PC and on the candidates for experts proposed for inclusion in the subject commissions created by Rosobrnadzor (hereinafter referred to as FPC).

1.5. Chairman of the SEC in relation to the activities of the PC:

a) submit for approval to Rosobrnadzor candidacies of chairpersons of the PC no later than one month before the start of the GIA;

b) organizes the formation of the composition of the PC;

c) determines, on the proposal of the chairmen of the PC, the candidates for members of the subject commissions sent for inclusion in the subject commissions created by Rosobrnadzor.

1.6. The composition of the PC for each academic subject is formed from persons who meet the following requirements:

The presence of higher education;

Compliance with the qualification requirements specified in the qualification guides and (or) professional standards;

Work experience in educational organizations (at least three years);

The presence of a document confirming the receipt of additional professional education, which includes practical classes (at least 18 hours) for assessing samples of examination papers in accordance with the assessment criteria for the relevant academic subject, determined by Rosobrnadzor;

Availability of the results of a qualification test, organized and conducted in the manner prescribed by the OIV.

A specialist who has not passed qualification tests in the current year is not allowed to be included in the PC, and also cannot take part in checking the detailed answers of the USE participants in the current year.

1.7. The OIV and the State Energy Commission of the constituent entity of the Russian Federation provide PCs with premises for work, which are located in close proximity to the RCOI in compliance with all information security requirements.

1.8. Information and technological support of the activities of the PC is carried out by the RCOI.

1.9. In the event of situations not covered by these Methodological Materials, the decision is made by the Chairman of the PC and / or the head of the RCOI within their competence with the obligatory subsequent informing of the SEC.

1.10. During the organization and conduct of the exam, the PC checks the detailed answers of the participants in the exam, completed on answer forms No. 2 (including on additional answer forms No. 2).

1.11. During the organization and conduct of the Unified State Examination, the distribution of functions between the PC experts is carried out depending on the status assigned to the expert based on the results of the qualification test: leading expert, senior expert, main expert.

1.12. Deadlines for processing examination materials.

The processing of the EM, including the verification of the detailed responses of the PC, must be completed within the time limits determined by the Procedure for conducting the State Examination:

In Russian language and mathematics - no later than six calendar days after the relevant exam;

For other academic subjects - no later than four calendar days after the relevant exam;

For exams that are held ahead of schedule and in additional terms - no later than three calendar days after the relevant exam.

II. The procedure for the formation of the PC

1. Draft amendments to regional regulations

1.1. The procedure for preparing PC experts, as well as the formation of PC (including the procedure for assigning status to experts) requires the formation at the regional level of a package of regulatory documents regulating the organization of the work of subject and conflict commissions.

1.2. The package of regional regulatory documents includes:

Regulations on the State Examination Commission in the subject of the Russian Federation;

Regulations on the subject commission of the subject of the Russian Federation;

Regulations on the conflict commission of the subject of the Russian Federation;

The procedure for the formation of a subject commission of a constituent entity of the Russian Federation (including the procedure for preparing experts, assigning statuses to experts, as well as analyzing the work of a PC in a constituent entity of the Russian Federation).

Possible wordings of the clauses of the Regulations on the State Examination Commission in the constituent entity of the Russian Federation, the Regulations on the subject commission of the constituent entity of the Russian Federation, the Regulations on the conflict commission of the constituent entity of the Russian Federation, taking into account changes in the organization of the work of the PC, are given in these methodological materials.

1.3. The procedure for the formation of a subject commission in a constituent entity of the Russian Federation should include, among other things:

Requirements for the experience of experts in checking the detailed answers of USE participants (for assigning statuses);

Indicators of the consistency of assessment based on the results of a qualification test and their significance (for assigning statuses);

The procedure for the procedure for assigning statuses to experts;

The procedure for admission of experts to pass the qualification test;

Description of the format of the qualification test for experts;

The procedure for the formation and analysis of the work of the PC.

1.4. The timing of each of the events for the training of experts and the formation of the PC is set at the regional level within the requirements for the timing defined at the federal level.

An approximate schedule for conducting activities for the training of experts and the formation of subject commissions is given in these methodological materials.

2. Statuses of PC experts

2.1. An expert can be assigned one of three statuses: leading expert, senior expert, main expert.

Leading expert - a status that allows you to be the chairman or deputy chairman of the PC, manage the preparation and / or training of experts at the regional level, participate in interregional cross-checks, be involved in the consideration of appeals on the subject, check and double-check the detailed answers of USE participants as part of the PC, including as a third expert.

Senior expert - a status that allows you to check and recheck assignments with a detailed USE answer as part of a PC, including being appointed for the third check of assignments with a detailed USE answer, participating in interregional cross-checks, as well as checks as part of an appeal on disagreement with points given.

The main expert is a status that allows you to carry out the first or second check of the execution of tasks with a detailed answer to the USE as part of a PC.

2.2. To assign a particular status to an expert, the correspondence of his qualifications must be established:

Requirements for experts, determined by the Procedure for conducting the GIA;

Requirements for the experience of evaluating examination papers of USE participants;

Requirements for the results of the qualification test;

Requirements for the consistency of work during the review in the previous year and the values ​​​​of the statistics of satisfied appeals.

2.3. Only experts with the status of leading or senior experts can be included in the lists of experts submitted to Rosobrnadzor by the chairman of the SEC for inclusion in the subject commissions created by Rosobrnadzor.

3. Coordination of approaches to the assessment of examination papers of USE participants at the federal and regional levels

3.1. To ensure the unity of approaches to assessing the detailed answers of USE participants, a three-level system for coordinating approaches to assessment is used. Measures to harmonize approaches to assessing the detailed answers of USE participants are carried out at the federal and regional levels.

a) Coordination at the federal level includes a number of measures to form common approaches to assessment among experts who claim to be leading experts. Activities include: discussion of approaches to assessment and typical difficulties of experts in assessing, assessment of samples of examination papers by the specified specialists in a remote mode, analysis of assessment results, conducting qualification tests.

b) Coordination at the regional level is ensured by the use of approaches to assessment coordinated at the federal level in the process of preparing experts. The training of experts should be carried out under the guidance of specialists with the status of leading experts, and include practical exercises on evaluating the detailed answers of graduates.

c) Operational coordination of approaches to assessment between PC experts immediately before checking the work, carried out on the day the examination of the examination papers of the USE participants begins.

3.2. Measures to harmonize approaches to assessing the detailed answers of USE participants at the federal level are organized by FGBNU "FIPI" and are carried out in two stages: correspondence and full-time.

a) Extramural stage (held from November to December). At this stage, specialists applying for the positions of chairmen and deputy chairmen of the PC (to assign the status of a leading expert) evaluate the work from the interregional bank of works. For this, a special Module of the Internet system for distance training of experts "Expert EGE" is used (the formation of an interregional bank of works is carried out by FIPI from images of examination papers selected by the heads of the PC of the constituent entities of the Russian Federation that caused difficulties and / or disagreements when assessing during the verification of the detailed answers of participants in the USE 2013) . The results of this stage are used to carry out the next (in-person) approval stage.

b) Face-to-face stage (conducted in the form of seminars from January to March). At this stage, specialists who have passed the correspondence stage participate in seminars to agree on approaches to assessing the detailed answers of USE participants.

During the seminars, when discussing approaches to assessment, a set of images of answers to individual tasks and entire works is formed, which will then be used to conduct qualification tests for experts in the Expert EGE Internet system.

3.3. Activities to harmonize approaches to assessing USE examination papers at the regional level are organized by the OIV. Coordination is carried out during the preparation of experts in accordance with educational programs and using methodological aids for the preparation of USE experts posted on the website of the FGBNU "FIPI" (www.fipi.ru).

3.4. When preparing experts at the regional level, the Internet system for remote training of experts "Expert EGE" and the materials posted in it can be used.

4. Qualification requirements for assigning statuses to experts

The status of a leading, senior or main expert is assigned depending on the expert's qualification level.

The following qualification requirements are established for assigning one or another status to experts.

4.1. The requirements for the education of experts and their experience in educational organizations are established by the Procedure for conducting the GIA:

The presence of higher education;

Compliance with the qualification requirements specified in the qualification reference books and (or) professional standards;

Experience in organizations engaged in educational activities and implementing educational programs of secondary general, secondary vocational or higher education (at least 3 years);

The presence of a document confirming the receipt of additional professional education, which includes practical exercises on the assessment of samples of examination papers in accordance with the assessment criteria for the relevant academic subject, determined by Rosobrnadzor.

4.2. To assign the status of a leading expert, experience in organizational work in a PC or SEC is required. The absence of such experience is allowed in the case when the PC includes less than 10 people.

4.3. The status of leading expert and senior expert can only be assigned to experts who have experience in evaluating the detailed answers of USE participants. To assign the status of a leading expert, the assessment experience must be at least 3 years. The requirements for the experience of evaluating the detailed answers of the exam participants are established by the OIV. Lack of verification experience is allowed only for newly organized PCs in foreign languages ​​(in cases where a regional PC in the corresponding academic subject was not previously created in a constituent entity of the Russian Federation).

4.4. The values ​​of the assessment consistency indicators, determined based on the results of qualification tests, must correspond to the values ​​determined by the OIV for assigning experts of each of the statuses. Recommended indicators of consistency and their values ​​based on the results of qualification tests for assigning each of the statuses to experts are given in.

The methodology for analyzing the consistency of the work of experts and analyzing the statistics of satisfied appeals of disagreement with the score is being developed by the JIU. The results of the assessment consistency analysis are used in the preparation of experts.

Consistency indicators and their values ​​based on the results of the analysis of the work of the PC when checking tasks with a detailed answer to the USE in the previous year and the statistics of satisfied appeals are established by the OIV.

5. Organization of a qualification test

5.1. The format for conducting qualification tests for experts is determined by the WEI.

5.2. The procedure for the admission of experts to pass the qualification test is established by the OIV.

5.3. A qualification test for assigning the status to an expert is carried out annually.

5.4. Information about the results of the qualification test and the status assigned to the experts is entered into the regional/federal register (regional federal/information system).

5.5. The qualification test can be carried out directly in the Internet system for remote training of experts "Expert EGE". Qualification tests to determine the status of experts in each academic subject are recommended to be carried out using the Internet system for remote training of experts "Expert EGE" (the selection of works for the creation of measuring materials is carried out by the FGBNU "FIPI") or similar resources developed by the subject of the Russian Federation.

6. The order of involving experts to work in the PC

6.1. PCs are formed from among the leading experts, senior experts, main experts.

The numbering of subparagraphs is given in accordance with the source.

c) Only experts with the status of leading expert may be appointed chairmen and vice-chairmen of the SC.

d) Experts who have been assigned the status of lead expert or senior expert in the current year may be appointed to conduct the third review.

e) Only experts who have been assigned the status of leading expert or senior expert in the current year can be involved in the consideration of appeals of disagreement with the score in the event of contentious questions regarding the assessment of the detailed answer of the USE participant.

f) Only experts who have been assigned the status of a leading expert or senior expert in the current year can be involved in rechecking the exam papers of USE participants.

g) Only experts who have been assigned the status of leading expert and senior expert in the current year can be involved in the inter-regional cross-checking.

III. Organization of verification of detailed answers

7. Methodology for evaluating detailed answers to the tasks of the examination paper

7.1. The detailed answers of the USE participants are evaluated by two independent experts.

7.2. Based on the results of the check, both experts independently assign points for each detailed answer or for each assessment position (if the answer to the task is evaluated separately for each assessment position) according to the criteria for assessing the performance of tasks with a detailed answer developed by FIPI and provided by the FCT.

7.3. In the event of a significant discrepancy in the scores given by the two experts, an additional third check is assigned.

7.4. A significant discrepancy for each academic subject is determined in the assessment criteria for the corresponding academic subject.

7.5. The third expert is appointed by the chairman of the PC from among the experts of the PC, who are members of the FPC, who have not previously checked this examination paper.

7.6. The third expert checks and assigns points for completing all tasks with a detailed answer, the assessment positions for which in the protocol form are not filled with the "X" sign. The third expert is provided with information about the scores given by the experts who previously checked the examination work of the USE participant.

7.7. The distribution of work between the PC experts, the determination of the final scores for the detailed answers of the USE participants to the tasks of the examination work, as well as the determination of the need for verification by a third expert, are carried out automatically, using the specialized software of the RCI.

7.8. The resulting scores for detailed answers are determined automatically, based on the following provisions:

If the scores given by the two experts match, then these scores are final;

If there is an insignificant discrepancy in the scores given by two experts, then the final scores are determined as the arithmetic mean of the scores of the two experts, rounded in accordance with the rules of mathematical rounding;

If a significant discrepancy is found in the scores given by the two experts, then an additional third check is assigned.

7.9. The scores of the third expert are final.

8. The procedure for checking detailed answers

8.1. Detailed answers of the USE participants are accepted for verification, completed only on answer forms No. 2 and additional answer forms No. 2, the form established by Rosobrnadzor, and filled in accordance with the "Instructions for filling out the USE forms".

8.2. The detailed answers of the USE participants are checked by the PC experts, guided by the criteria for evaluating the detailed answers.

8.3. The detailed answers of the USE participants are evaluated by two PC experts independently. Both experts checking one work independently assign points for each detailed answer or for each assessment position (if the answer to the task is evaluated separately for each assessment position) according to the criteria for assessing the performance of tasks with a detailed answer.

8.4. Before the start of the work of the PC, the chairman of the PC receives from the head of the RCOI the criteria for evaluating detailed answers received from the FCT on the day of the exam.

8.5. The expert is provided with a working kit of the PC expert, which contains:

Impersonal copy forms (form 2-RTsOI) with images of detailed answers of the participants of the USE participant (hereinafter referred to as the copy form) - no more than 20 pieces in one working set;

Form protocol (form 3-RTSOI) for checking by an expert the detailed answers of USE participants (hereinafter referred to as the protocol form).

8.5.1. The blank copy is an image of the answer form N 2 of the USE participant and additional answer forms N 2, if they were filled out by the participant, in the registration part of which are indicated:

Copy blank code;

Information about the expert appointed to check the blank copies of the working set (surname, name, patronymic of the expert, code of the expert);

The date of the exam;

Protocol number and line number in the protocol corresponding to the given code of the copy form;

CMM variant number;

The page number and the number of pages filled out by the USE participant in the answer form N 2, including the additional answer form N 2,

Region code.

8.5.2. The blank protocol is a table that contains the codes of the blank copies of the received work kit and the fields for the expert to enter points for the answers. The registration part of the protocol form contains:

Information about the expert appointed to check the forms (surname, name, patronymic of the expert, code of the expert);

Name of the subject;

The date of the exam;

Protocol number;

Region code.

8.6. The blank protocol is a machine-readable form, and is subject to mandatory automated processing in the RCOI.

8.7. Work kits are formed (printed out) for each expert at the RCOI, taking into account the work schedule of the PC.

8.8. The Chairman of the PC receives ready-made working sets of experts from the head of the RCOI.

8.9. Experts check the work and put points in the appropriate fields of the protocol form in accordance with the criteria for evaluating detailed answers.

8.10. After completion of the verification of the work of each working set, the completed protocol form and copies of the working set are transferred to the RCSC for further processing.

8.11. After the automated processing of the forms-protocols in the RCSC, the RCSC software automatically analyzes the results of checking the work by experts in an automatic mode without the participation of an operator. As a result of this analysis, papers may appear that require an additional third check. Works are sent for the third check in case of a significant discrepancy in the evaluation of the detailed answers of the exam participant by two different experts.

8.11.1. A significant discrepancy for each academic subject is determined by the assessment criteria and is incorporated into the automated processing algorithm.

8.11.2. Only an expert who is a member of the FPC in the relevant academic subject can check the work assigned for the third check.

8.11.3. On the form-copy of the work scheduled for the third check, in the registration part for the information of the third expert, the points given by two experts who checked this work earlier are indicated. The third expert evaluates according to the assessment items indicated in the protocol form. The assessment positions that the third expert does not check in the protocol are filled with "X" symbols.

8.12. The verification of the detailed answers of the USE participants is considered completed when all the works have been checked by the experts the required number of times, and the results of the evaluation from the protocol forms have been analyzed by the RCCI software.

8.13. During the period of work of the PC, the chairman of the PC and (or) his deputy fixes the number of works that caused the greatest disagreement during evaluation. These works will be used further for the training of PC experts next year.

8.14. During the period of work of the SC, the chairman of the SC asks the head of the RCSC for statistical information on the progress of checking detailed answers. At the same time, the Chairman of the PC is provided with information both on the number of works checked one, two or three times, on the number of works awaiting the first, second or third check, and on the number and percentage of works scheduled for the third check. The results of statistical reports are used by the chairman of the PC to optimize the organization of the work of the PC.

8.15. When conducting an interregional cross-check, the images of answer forms No. 2 received from another subject of the Russian Federation are checked by PC experts in the general queue of work of USE participants.

8.16. During the period of work of the PC from the moment of receiving the criteria for evaluating detailed answers from the RTSOI until the end of checking the detailed answers of the USE participants, all premises in which the PC operates must be provided with a continuous video surveillance and video recording system.

8.17. The organization of video surveillance in the premises of the PC is provided by the OIV.

9. Organization of the work of the PC when rechecking the results of the exam

9.1. When a decision is made by the SEC or Rosobrnadzor to recheck a number of works of USE participants, the recheck is carried out by PC experts who are members of the FPC.

9.2. The RCOI enters information about the USE participants, whose works were sent by decision of the SEC for rechecking, into the RIS and generates (prints) sets of documents for rechecking.

9.3. The set of documents for rechecking contains:

Copies of answer forms No. 2, including additional answer forms No. 2;

Copies of protocol forms for checking detailed answers;

The form of the protocol of rechecking, containing the opinion of experts on the correctness of the assessment of detailed answers to the tasks of this examination paper;

A variant of the CMM performed by an exam participant.

9.4. The Chairman of the PC receives the prepared kits from the head of the RCOI.

9.5. PC experts carry out a recheck of the received works and fill in the recheck protocol form.

9.6. The chairperson of the PC submits the executed recheck protocols to the SEC for approval.

9.7. The recalculation of points based on the results of the recheck based on the protocols of the recheck is carried out by the RCSC together with the FCT within its competence.

IV. Rules for the chairman and members of the subject committee

10. Rules for the Chairman of the SC

10.1. Preparatory activities

10.1.1. Preparatory activities to determine the composition and qualifications of PC experts are carried out in accordance with the established procedure for conducting the GIA, the FIPI methodological materials, and the normative and methodological materials of the OIV.

10.1.2. Not later than 14 days before the start of the processing of the USE materials, the chairman of the PC for the relevant academic subject agrees with the head of the RCOI on the work schedule of the PC during the processing of the EM for this academic subject.

10.1.3. Not later than 14 days before the start of processing the USE materials in the relevant academic subject, the chairman of the PC transfers the schedule of work of PC experts to the head of the RCOI to plan the appointment of experts to check the work; in the same document, the chairman of the PC indicates for each expert of the PC whether he is a member of the FPC.

10.1.4. The Chairman of the PC will coordinate with the head of the RCOI the work schedule of the experts who check the blank forms;

10.2. At the stage of checking the answer forms No. 2, the chairman of the PC must:

10.2.1. receive from the head of the RCSC a complete set of criteria for assessing the performance of tasks with a detailed answer and the required number of sets of criteria for experts;

10.2.2. receive the number of working sets necessary for checking by experts as the detailed answers are processed and checked in the RCI;

10.2.3. before the start of the work of the experts, conduct a briefing in accordance with the received criteria for evaluating the performance of tasks;

10.2.4. to distribute experts by workplaces in the provided audiences;

10.2.5. ensure the presence in the classrooms of only authorized persons - in addition to experts and the chairman of the PC, the audience may include:

Head of the RCOI (or his deputy);

Member of the SEC;

Officials of Rosobrnadzor or OIV who carry out field (inspection) verification of the procedure for conducting the State Examination;

Public observers accredited in accordance with the established procedure;

10.2.6. give each expert a set of criteria for assessing the performance of tasks with a detailed answer for each option and a working set for verification;

10.2.7. ensure a working atmosphere and discipline in the work of the PC: during work, experts are prohibited from:

To issue, after completion of work, working kits and / or parts thereof, as well as criteria for assessing the performance of tasks, texts of KIM tasks, etc.;

10.2.8. within its competence, resolve issues that arise from experts, and, if necessary, resolve issues related to the competence of the RCOI, coordinate their decisions with the head of the RCOI;

10.2.9. control the quality of filling in the protocol forms by the experts and promptly transfer the protocol forms and copies to the RCOI;

10.2.10. promptly eliminate the difficulties that arise for experts;

10.2.11. if the working set, for a number of objective reasons, was not fully checked by the expert, then it is necessary to inform the head of the RCOI and transfer this set with the verification protocol to him;

10.2.12. forms-copies of the entire working set, not fully checked by the expert, to transfer to the head of the RCOI for reassignment to other experts;

10.2.13. upon completion of the work of the PC, submit to the head of the RCOI all the criteria for evaluating answers to tasks with a detailed answer issued for verification;

10.2.14. upon completion of the check, receive from the head of the RCOI a package of documents on the results of the work of the PC:

The number of works checked by each expert;

The number of works sent for the third check;

Information about the experts who showed the largest number of discrepancies in the evaluation results;

10.3. when considering appeals of disagreement with the USE scores (hereinafter referred to as the appeal based on the results)

10.3.1. receive from the responsible secretary of the QC an appeal set of the USE participant;

10.3.2. receive from the head of the RTSOI the criteria for assessing the performance of tasks with a detailed answer of the KIM variant, according to which the USE participant who filed the appeal took the exam;

10.3.3. appoint for consideration the appeals of experts who are members of the FPC, who have not previously reviewed this work, and transfer the above materials to them;

10.3.4. find out from the responsible secretary of the CC of the subject of the Russian Federation the time for the consideration of the appeal;

10.3.6. promptly transfer to the RCOI for Rosobrnadzor, FCT information about the possible incorrectness of tasks with the obligatory indication of the number of the KIM version, the task and the content of the remark;

The decision on the correctness of the assignment and on changing the scores for USE participants in the event that the assignment is recognized as incorrect is made at the federal level. If the task is recognized as incorrect, all USE participants who completed this task are recalculated points.

11. Rules for PC Experts

Experts must:

11.1. at the preparatory stage, undergo training and confirm qualifications in accordance with the requirements of the established procedure for conducting the GIA, the FIPI methodological materials, as well as the normative and methodological materials of the OIV.

11.2. be instructed in advance on the content and technology of evaluating detailed answers, within the time limits determined by the chairman of the PC.

11.3. Experts who have not confirmed their qualifications and / or have not been instructed are not allowed to check detailed answers;

11.4. while checking detailed answers

11.4.1. at the direction of the chairman of the PC, take jobs in the provided classrooms;

11.4.2. receive working kits for verification;

11.4.3. observe discipline during work;

11.4.4. During work, experts are prohibited from:

Independently change jobs;

Use means of communication, photo and video equipment, portable personal computers (laptops, PDAs and others);

Leaving the audience without a valid reason;

Negotiate, if it is not a consultation with the chairman of the PC or with an expert appointed by the decision of the chairman of the PC, a consultant;

Upon completion of the work, issue working sets and / or parts thereof, as well as criteria for evaluating detailed answers;

If an expert has questions or problems, he should contact the chairman of the PC or the head of the RCOI (his deputy), who solve them within their competence;

11.4.5. start checking the detailed answers following the following rules:

Fill in the fields of the protocol form in block capital letters with a black gel pen strictly inside the fields of the protocol form;

The use of a pencil (even for rough notes), pens with light ink and putty to correct what is written is unacceptable (the presence of a stylus or putty on a scanned form can lead to serious damage to the scanner);

The corrections made must be unambiguously interpreted, all corrections are recorded and certified by the expert's signature (corresponding entries are made at the bottom of the protocol form);

If the USE participant did not start the task, then in the field in which the score for this answer to the task in the protocol form should be marked "X";

If the USE participant started to complete the assignment, then in the corresponding field (fields) of the protocol form, the corresponding score (points) should be entered from zero to the maximum possible, indicated in the criteria for evaluating the performance of tasks with a detailed answer;

If the USE participant performed an alternative task, then the number of the alternative task chosen by the USE participant should be entered in the appropriate field of the protocol form;

11.4.6. after completing the completion of the protocol form, put the date, sign in the appropriate fields of the protocol form and transfer the working set to the chairman of the PC for processing;

11.5. when checking empty answer forms N 2:

11.5.1. receive instruction from the head of the RCOI;

11.5.2. view images of blank answer sheets N 2 from the screen;

11.5.3. if there are entries, signs, drawings or marks on the image that can be regarded as an answer to a task with a detailed answer or confirmation that the USE participant started to complete the task or had the opportunity to complete it, but did not complete it for some reason, certify (mark in software) that the image is full;

11.5.4. in the absence of records related to the answer to the tasks, certify (mark in the software) that the image is not filled out;

11.5.5. images determined by at least one of the reviewing experts as completed are sent to the PC for verification.

Images identified by all checking experts as blank refer to the answers to tasks that the USE participant did not start. In this case, automatically by means of RIS, the answers are evaluated at zero points for completing each task with a detailed answer;

11.6. when considering appeals of disagreement with the USE scores:

11.6.1. receive from the chairman of the PC copies of answer forms No. 2, protocol forms for checking work by experts, criteria for assessing the completion of a task with a detailed answer of the KIM variant, according to which the USE participant who filed an appeal took the exam;

11.6.2. to review the work of the appellant, as well as to analyze the previous evaluation of the work;

11.6.3. find out from the chairman of the PC the time for the consideration of the appeal and arrive at the CC at the specified time;

11.6.4. in the event that the appellant or the QC has any claims to the evaluation of detailed answers, provide appropriate explanations;

11.6.5. draw up a conclusion on the correctness of the evaluation of the detailed answers for which an appeal was filed;

11.6.6. in case of detection of errors or incorrect tasks in the CMM, it is necessary to inform the chairman of the PC about this with the obligatory indication of the number of the CMM version, the task and the content of the remark.

The decision on the correctness of the assignment and on changing the scores for USE participants in the event that the assignment is recognized as incorrect is made at the federal level. If the task is recognized as incorrect, all USE participants who completed this task are recalculated in accordance with the administrative act of Rosobrnadzor.

These indicators can be adjusted taking into account the characteristics of the subjects.

Indicator: Percentage of items/assessment criteria for which the assessor's scores did not match the scores generated when agreeing approaches to assessing long responses.

Indicator: Percentage of assignments/assessment criteria with a difference of 2 or more points on the assignment/assessment criterion

Annex 2

Recommended changes to the Regulations on the State Examination Commission in a constituent entity of the Russian Federation and to the Regulations on the subject commission of a constituent entity of the Russian Federation

The section of the Regulations that is being amended	Wording
	The composition of subject commissions for a general education subject includes specialists who meet the following requirements: - higher education; - compliance with the qualification requirements specified in the qualification reference books and (or) professional standards; - work experience in organizations engaged in educational activities and implementing educational programs of secondary general, secondary vocational or higher education (at least three years); - the presence of a document confirming the receipt of additional professional education, which includes practical classes (at least 18 hours) for assessing samples of examination papers in accordance with the assessment criteria for the relevant academic subject, determined by Rosobrnadzor - the presence of the status of a leader, senior or main expert.
Section "Structure and composition of PC"	The functionality available to an expert is determined by the status assigned to him: - the lead expert has the right to be appointed chairman or vice-chairman of the SC, to manage the preparation and / or training of experts at the regional level, to participate in interregional cross-checks, to be involved in the consideration of appeals on the subject, to carry out verification and rechecking of works as part of the PC, including as a third expert. - the senior expert has the right to check and recheck the performance of tasks with a detailed answer of the USE as part of the PC, including being appointed for the third check of the fulfillment of tasks with a detailed answer of the USE, to be involved in the consideration of appeals on the subject, to participate in interregional cross-checks; - the main expert has the right to carry out the first / or second verification of the fulfillment of tasks with a detailed answer to the USE as part of the PC.
Section "Structure and composition of PC"	The third expert is appointed automatically from among the members of the subject committee who have the status of a leading expert or senior expert who have not previously checked this examination paper.
Section "Structure and composition of PC"	When organizing the exchange of examination papers of USE participants between the constituent entities of the Russian Federation, experts are involved in checking such papers, who have been assigned the status of a leading expert or senior expert in the current year.
Item "Chairman of the PC during the preparation and conduct of the exam carries out"	During the period of preparation and conduct of the Unified State Examination, the Chairman of the PC carries out: - organization of annual training (training seminars) for specialists, taking into account the results of the analysis of the consistency of the work of experts and the statistics of satisfied appeals; - submission to the SEC of proposals on the composition of the subject commissions, on the candidacies of experts proposed for inclusion in the composition of the subject commissions created by Rosobrnadzor; - organization of coordination of approaches to assessment between experts, carried out on the day of the start of checking the examination papers of USE participants; - selection of experts to be involved in the work in the conflict commission, from among the experts who have been assigned the status of leading expert or senior expert in the current year; - selection of examination papers of USE participants that caused difficulties in assessment.
Item "Chairman of the PC during the preparation and conduct of the exam is obliged"	During the preparation and conduct of the Unified State Exam, the Chairman of the PC has the right to participate in annual seminars on the coordination of approaches to assessing the performance of tasks with a detailed answer to the Unified State Examination, organized by FGBNU "FIPI".
Item "Member of the PC during the preparation and conduct of the exam is obliged"	During the period of preparation and conduct of the Unified State Examination, a member of the PC is obliged to pass an annual qualification test, according to the results of which an expert can be assigned one status or another.

Recommended changes to the Regulations on the conflict commission of the constituent entity of the Russian Federation

Annex 3

Approximate schedule
holding events for the training of experts and the formation of subject commissions

N p/p	Event	Term
1.	Amendments to regulatory documents at the regional level	Until February 17
2.	Evaluation of works from an interregional bank by specialists applying for the status of leading experts	November December
3.	Collection of information about participants applying for the positions of PC leaders in face-to-face seminars to agree on approaches to assessing the detailed answers of USE participants	December
4.	Conducting face-to-face seminars to harmonize approaches to assessing the detailed answers of USE participants	January February
5.	Submission to the Federal State Budgetary Scientific Institution "FIPI" of the lists of candidates for the chairmen of the PC, formed in the constituent entities of the Russian Federation	Until March 1
6.	Approval by Rosobrnadzor of candidates for chairmen of the PCs of constituent entities of the Russian Federation	Until March 10
7.	Preparation of experts of the PC of the constituent entities of the Russian Federation for checking the examination papers of the Unified State Examination in 2014	February March
8.	Assigning statuses to experts of the USE PC	March
9.	Formation of PC of subjects of the Russian Federation	until 01 April
10.	Formation of PCs created by Rosobrnadzor	Until 01 April
11.	Carrying out operational coordination of evaluation of detailed answers	The first day of checking the work on the subject
12.	Selection of examination papers of USE participants that caused difficulties in assessment for inclusion in the interregional bank of papers	In the process of checking work

Document overview

The procedure for the formation of the HEC structure is considered. The main powers are listed. The commission organizes the work on the preparation and conduct of the State Examination, makes decisions on admission to certification, generates the necessary reports, considers proposals for the composition of the subject commission, etc. The term of office is 1 year.

As a rule, the SEC holds its meetings according to the schedule. Based on the results of the commission's work in the current year, a certificate is being prepared on the conduct of the GIA in the region, including information on the composition of participants, on the results of attestation, and on the problems that have occurred.

The composition of the commission is formed from persons who meet the following requirements. The presence of higher education. Compliance with the qualification requirements specified in the reference books and (or) professional standards. At least 3 years experience in educational institutions. The presence of a document confirming the receipt of additional vocational education, including practical classes (at least 18 hours) for evaluating samples of examination papers. The person has passed a special qualification test.

The procedures for checking and processing examination materials have been regulated. In the Russian language and mathematics, the latter must be completed no later than 6 calendar days after the exam. For other academic subjects - no later than 4 calendar days. For exams that are held ahead of schedule and in additional terms - no later than 3 calendar days.

FEDERAL SERVICE FOR SUPERVISION IN EDUCATION AND SCIENCE

_______________________________________________________________________

FEDERAL STATE BUDGET SCIENTIFIC INSTITUTION

"FEDERAL INSTITUTE OF PEDAGOGICAL MEASUREMENTS"

Unified training materials for the preparation of chairmen of subject commissionsUSE 2016

CHEMISTRY

Unified educational materials for the preparation of chairmen of the regional subject commissions of the USE 2016 in chemistry are designed for full-time and distance training of subject commissions for evaluating tasks with a detailed answer, which are part of the control measuring materials of the unified state exam in chemistry.

The training materials provide schematic information about the normative bases and stages of work of the subject commission, brief recommendations on how to overcome typical problem situations of assessment. The materials contain images of examination papers for organizing qualification tests of PC experts.

© Federal Institute of Pedagogical Measurements, 2016

Input control. 6

Module 1. Regulatory framework for the work of the subject commission. 7

Module 2. Organization of the work of the subject commission. 25

Coordination of assessment approaches.. 25

expert status. 26

Stages of work of subject commissions. 28

Analysis of the quality of work of the subject commission. 34

Module 3

Module 4

Module 5. Materials for the organization of qualification tests of experts SC 44

Final control. 73

List of symbols, abbreviations and terms

Blank protocol	Protocol for checking by an expert the results of completing tasks of an examination paper with a detailed answer
	State final certification for educational programs of secondary general education
	State Examination Commission of the Subject of the Russian Federation
	Unified State Exam
Images of examination papers, samples of examination papers	Images of texts of detailed answers of USE participants used at the stages of preparation and certification of PC experts
Expert qualification	The level of knowledge, skills, abilities (competencies), characterizing the readiness to perform activities for checking tasks with a detailed answer to the exam
Qualification test	Test to establish the level of expertise of an expert
	Control measuring materials
	Conflict Commission of the subject of the Russian Federation
	Subject commission of the subject of the Russian Federation
	The procedure for conducting the state final certification for educational programs of secondary general education, approved by order of the Ministry of Education and Science of the Russian Federation dated 01/01/2001 No. 1400 (registered by the Ministry of Justice of Russia on 02/03/2014, registration No. 31205)
	Regional information system for ensuring the state final certification of students who have mastered the basic educational programs of basic general and secondary general education
Extended answers	Answers of participants of the Unified State Examination (GVE) to the tasks of the examination work with detailed answers
Rosobrnadzor	Federal Service for Supervision in Education and Science
Expert status	Confirmed expert qualification level
GIA member	A student admitted in the prescribed manner to the State Academic Examination, a graduate of previous years studying in educational programs of secondary vocational education, a student receiving secondary general education in foreign educational organizations, admitted to passing the Unified State Examination
	FGBNU "Federal Institute of Pedagogical Measurements"
	A person who meets the requirements of paragraph 21 of the Procedure

Input control

1. What types of checks does the subject commission carry out?

2. What formal requirements for the qualification of a specialist, according to the Procedure for conducting the Unified State Examination, allow him to be involved as an expert of the PC?

3. What tasks are solved during the training of experts by the chairman of the PC?

4. What statuses of experts are determined by the Guidelines for the formation and organization of the work of the PC...?

5. What requirements must the lead expert meet? senior expert? main expert?

6. What is the importance of briefing the experts by the chairman of the PC before starting to check the examination papers?

7. What basic rules should the PC follow when checking examination papers?

8. What function do PC experts perform when considering appeals of disagreement with the USE results?

9. By what parameters is the work of the PC analyzed?

Module 1. Regulatory framework for the work of the subject commission

The procedure for preparing PC experts, as well as the formation of a PC, requires the formation at the regional level of a package of regulatory documents regulating the organization of work of the PC and QC.

The composition of the package of regional documents is shown in Scheme 1.

Scheme 1

Guidelines for the formation and organization of the work of subject commissionssubject of the Russian Federationwhen conducting the state final certification for educational programs of secondary general education (Appendix 9 to the letter of Rosobrnadzor dated December 25, 2015 No. 01-311 / 10-01), section 3

The executive authorities of the constituent entities of the Russian Federation, which carry out state administration in the field of education, ensure the conduct of the GIA (see Chart 2):

Scheme 2

The procedure for conducting the state final certification for educational programs of secondary general education (Appendix to the Order of the Ministry of Education and Science of Russia No. 000 of 01/01/2001), clause 14.

The channels for informing students and their parents (legal representatives), graduates of previous years on the organization and conduct of the SIA are presented in Scheme 3.

Scheme 3

The composition of the PC for each academic subject is formed from persons who meet the following general requirements (see diagram 4):

Scheme 4

Guidelines for the formation and organization of the work of subject commissions of the constituent entity of the Russian Federation during the state final certification for educational programs of secondary general education (Appendix 9 to the letter of Rosobrnadzor dated December 25, 2015 No. 01-311 / 10-01), section 2, paragraph 7.

The general management and coordination of the activities of the PC in the relevant academic subject is carried out by its chairman. The general functions of the SC Chairman are shown in Diagram 5.

Scheme 5

The procedure for conducting the state final certification for educational programs of secondary general education (Appendix to the Order of the Ministry of Education and Science of Russia No. 000 of 01/01/2001), clause 22.

During the organization and conduct of the GIA, the distribution of functions between the SC experts is carried out depending on the status assigned to the expert based on the results of the qualification test: leading expert, senior expert, main expert (see table 1):

Table 1

Guidelines for the formation and organization of the work of subject commissions of the constituent entity of the Russian Federation during the state final certification for educational programs of secondary general education (Appendix 9 to the letter of Rosobrnadzor dated December 25, 2015 No. 01-311 / 10-01), section 2, paragraph 14; section 3.

The process of evaluating detailed answers to the tasks of the examination paper is shown in Scheme 6.

Scheme 6