1.1. Contact organisation
Statistical Office of the Republic of Serbia
1.2. Contact organisation unit
Information Society Statistics unit
1.3. Contact name
Restricted from publication1.4. Contact person function
Restricted from publication1.5. Contact mail address
Milana Rakica 5, Belgrade
1.6. Contact email address
Restricted from publication1.7. Contact phone number
Restricted from publication1.8. Contact fax number
Restricted from publication2.1. Metadata last certified
29 November 20242.2. Metadata last posted
29 November 20242.3. Metadata last update
29 November 20243.1. Data description
The EU survey on the use of ICT in households and by individuals is an annual survey conducted since 2002. In Republic of Serbia, it has been conducted since 2006.
In 2024, the survey collects data on the access to information and communication technologies (ICT), on the use of the internet, e-government, e-commerce, as well as green ICT.
3.1.1. Survey name in national and English languages
National language: Употреба информационо–комуникационих технологија у Републици Србији
English: EU survey on the use of ICT in households and by individuals
Questionnaire(s) in national language(s) and the translation in English are available in the Annexes below.
3.2. Classification system
The following common concepts and definitions apply under the Integrated European Social Statistics (IESS):
- the International Standard Classification of Education (ISCED) 2011 published in the following breakdowns: low (ISCED levels 0-2: no formal education, primary education or lower secondary education), medium (ISCED levels 3-4: upper secondary or post-secondary non-tertiary education) and high (ISCED levels 5-6: tertiary programmes which normally need a successful completion of ISCED 3 or 4, or second-stage tertiary education leading to an advanced research qualification);
- the International Standard Classification for Occupation ISCO-08 at the 2-digit level;
- the Classification of Economic Activities (NACE Rev.2-2008), at section level;
- the Common classification of territorial units for statistics (NUTS 1) – finer granularity of NUTS 2 is provided on optional basis by some Member States;
- the SCL – Geographical code list;
- information about household income is provided at lower level of detail.
Additional classifications used in the national questionnaire: No additional classification
3.3. Coverage - sector
The ICT survey in households and by individuals covers those households having at least one member in the age group 16 to 74 years old. Internet access of households refers to the percentage of households that have internet access, so that anyone in the household could use the internet.
3.3.1. Differences in scope at national level
No differences.
3.4. Statistical concepts and definitions
The survey is collecting data of internet users, individuals who have used the internet in the three months prior to the survey.
This annual survey is used to benchmark ICT-driven developments, both by following developments for core variables over time and by looking in greater depth at other aspects at a specific point in time. While the survey initially concentrated on access and connectivity issues, its scope has subsequently been extended to cover a variety of subjects (for example, the use of internet, e-government, e-commerce, internet of things and green ICT) and socio-economic analysis (such as regional diversity, gender specificity, differences in age, education and the employment situation). The scope of the survey with respect to different technologies is also adapted to cover new product groups and means of delivering communication technologies to end-users.
For more details on the methodology applicable in each survey year, please consult the Compiler's Manual for the respective year.
Deviations from standard ICT concepts: No deviations
3.5. Statistical unit
Households and Individuals
3.6. Statistical population
In the ICT usage survey, the target population for the different statistical units is:
- individuals: all individuals aged 16 to 74;
- households: all (private) households with at least one member aged 16 to 74.
Target population composed of households and/or individuals:
- Number of households: 2379115
- Number of individuals: 5020228
3.6.1. Non-compulsory age groups
Non-compulsory age groups also included in the target population:
| No | Yes | Age scope | |
| Individuals younger than 16? | X | ||
| Individuals older than 74? | X |
3.6.2. Population not covered by the data collection
| Non-target population (the difference between the total population and the target population) | Households | Individuals |
|---|---|---|
| Approximate number of units outside the general scope of the survey (for example individuals younger than 16 or older than 74; households with all members over 74 years old). | 190195 | 1574170 |
| Estimate of the resulting percentage of under-coverage (non-covered population compared to the total country), if applicable | 7.40 | 23.87 |
3.7. Reference area
All households and persons referring to the “usual population’’ that reside in the territory of the Republic of Serbia, without Region Kosovo and Metohia.
3.8. Coverage - Time
Year 2024
3.9. Base period
Not applicable
Percentages of ‘Households’ and Percentages of ‘Individuals’
For most questions the reference period is the last three months before the interview. Questions in the modules on e-government and eID refer to the 'last year' before the interview.
Deviation from this statement: No deviations
5.1. Survey period
15 February 2024 - 29 February 2024
6.1. Institutional Mandate - legal acts and other agreements
The legal basis for the 2024 EU survey on the use of ICT in households and by individuals is the Regulation (EU) 2019/1700 of the European Parliament and of the Council of 10 October 2019 establishing a common framework for European statistics relating to persons and households, based on data at individual level collected from samples (OJ L 261 I, 14 October 2019, p. 1), as implemented by the Commission Implementing Regulation (EU) 2023/1484 of 18 July 2023 specifying the technical items of the data set, establishing the technical formats for transmission of information and specifying the detailed arrangements and content of the quality reports on the organisation of a sample survey in the use of information and communication technologies domain for reference year 2024 in accordance with Regulation (EU) 2019/1700 of the European Parliament and of the Council (OJ L 182, 19 July 2023, pp. 100-149) and Commission Delegated Regulation (EU) 2023/1797 of 7 July 2023 supplementing Regulation (EU) 2019/1700 of the European Parliament and of the Council by specifying the number and titles of the variables for the use of information and communication technologies statistics domain for the reference year 2024 (OJ L 233, 21 September 2023).
Complementary national legislation constituting the legal basis for the survey on the use of ICT in households and by individuals: Law on Official Statistics (“Official Gazette of the Republic of Serbia, No 104/09) and Plan of Official Statistics (“Official Gazette of the Republic of Serbia” Nos 55/05, 71/05 – corrigendum, 101/07, 65/08, 16/11, 68/12 – CS, 72/12, 7/14 – CS, 44/14 and 30/18 – other law)
6.2. Institutional Mandate - data sharing
Other authorized producers of official statistics shall be obliged to cooperate with the Office on the methodology of statistical surveys that are envisaged by annual implementation plans, and when required, they consult the Office on the methodology and databases that they determine. In case of disagreement between the authorized producers of official statistics and the Office in relation to the issues as described in paragraph 1 hereof, the Office shall be obliged to advise respectively the Government, in writing and within 30 days after the disagreement was stated. Right to access individual data of other authorized producers of official statistics.
The Office shall have the right to access individual data resulting from the surveys of other authorized producers of official statistics, in case these data are essential for conducting the activities of official statistics or for the evaluation of data quality. The right to access individual data resulting from the surveys of the National Bank of Serbia shall be granted with prior written consent by the Governor of the National Bank of Serbia. Right to access administrative data sources
The Office shall have the right to access all administrative data sources in charge of government authorities, including identification codes, if necessary, as well as the right to access the data collected by constant monitoring and observation method, unless their statistical use is explicitly prohibited by law. The holders of administrative data sources and of data collected by constant monitoring and observation method are obliged to forward the data to the Office in accordance with the adopted Plan and in a way as agreed that shall entail no extra costs for the data holders, except in cases when these data are subject to special processing.
7.1. Confidentiality - policy
The data collected, processed and stored for the purpose of official statistics shall be considered as confidential when a physical person or a legal entity could be identified, directly or indirectly, by name (title), address or identification number. The authorized producers of official statistics shall use all means to preclude any possible, direct or indirect, individual identification of a reporting unit. Confidential data may be used for statistical purposes only. Therefore, the authorities of the republic government, the autonomous provinces’ government, the local government and other public authorities may not use the data and information compiled as official statistics for the purpose of defining the rights and obligations of a reporting unit.
7.2. Confidentiality - data treatment
The authorized producers of official statistics are obliged to take all relevant administrative, technical and organizational measures required to protect confidential data from illegal access, disclosure or use. In a special set of regulations or other legal act, the authorized producers of official statistics shall define in more details the measures and procedures of data confidentiality protection, in accordance with this law.
Access to confidential data shall be restricted to the persons that in line of their duty produce official statistics and to the extent to which these data are required for the production of official statistics. The persons who in line of their duty have access to confidential data are under obligation to conform to the provisions of this law, even upon cessation of their term of office with statistical authorities.
8.1. Release calendar
25 October 2024
There is a release calendar for the statistical outputs.
8.2. Release calendar access
8.3. Release policy - user access
Annual
10.1. Dissemination format - News release
Information not available
10.2. Dissemination format - Publications
УПОТРЕБА ИНФОРМАЦИОНО-КОМУНИКАЦИОНИХ ТЕХНОЛОГИЈА У РЕПУБЛИЦИ СРБИЈИ, 2024.
Publication in Serbian language
10.3. Dissemination format - online database
10.3.1. Data tables - consultations
Information not available
10.4. Dissemination format - microdata access
Microdata are not disseminated.
10.5. Dissemination format - other
Information not available
10.5.1. Metadata - consultations
Information not available
10.6. Documentation on methodology
Metadata - Usage of ICT in households
10.6.1. Metadata completeness - rate
Information not available
10.7. Quality management - documentation
1. The Eurostat Methodological Manual provides guidelines and standards for the implementation of the survey in the Member States. The manual is updated and adapted every year according to the content of the model questionnaire. Furthermore, the use of the Eurostat model questionnaire improves comparability of the results of the survey among participating countries.
2. Procedure for hiring interviewers (Tender and subsequent Selection Decisions published on the Intranet)
3. Training of interviewers for ICT research
4. Continuous control of interviewers (listening, daily control of survey results)
5. Validation according to Eurostat rules
6. Preparation of a national Quality Report and reference metadata (used for quality assessment)
7. Conducting self-assessment by filling out a self-assessment questionnaire and preparing an accompanying report (self-assessment) - also for quality assessment
11.1. Quality assurance
The SORS (Statistical office of the Republic of Serbia) quality management system is relied on the Serbian official statistics mission and vision, as well as on the European Statistics Code of Practice – CoP and the Total Quality Management – TQM principles, which together make the common quality framework of the European Statistical system (ESS). Based on this framework SORS prepared main strategic documents on quality, like Declaration on quality, Quality policy, Quality strategy, as well as different guidelines and procedures for ensuring quality of statistical production.
For more information, please see the Declaration of quality.
11.2. Quality management - assessment
Indicators of ICT usage in households are produced in accordance with methodological requirements and standards. Data are compared with previous and corresponding period and checks with different source are made. The publication schedule is fixed and announced in advance.
12.1. Relevance - User Needs
Main user at national level is RATEL (Republic Agency for Electronic Communications) and Ministry of Trade, Tourism and Telecommunications.
12.2. Relevance - User Satisfaction
RATEL (Republic Agency for Electronic Communications) has evaluated positively the data quality on the ICT usage in households and by individuals.
12.3. Completeness
Missing variables (not transmitted to Eurostat):
Mandatory variables:
- GEO_DEV
- DEG URBA
SORS cannot provide this variable since there is no legal act with defined methodological criteria for type of settlements that would be valid for the whole territory of the Republic of Serbia. However, a new methodology about level of urbanization at national level is in the progress of development and there is hope that it will be finished next year with some longer timeline for National assembly to adopt it.
12.3.1. Data completeness - rate
99%
13.1. Accuracy - overall
Information not available
13.2. Sampling error
Calculating of the sampling errors was done using the SPSS software. It uses the Taylor expansion method to estimate sampling errors of the estimators based on complex sample designs.
Sample design is two-stage stratified. Procedure in the SPSS estimates variance from the variation among PSUs and variance depends only on the first stage of the sampling design.
Using the Analyze Complex Samples in SPSS were calculated: Standard error of the estimate, Confidence interval, Coefficient of variation.
References: SPSS Complex Samples, Särndal C.-E., B. Swensson, J. Wertman (2003), Model Assisted Survey Sampling, Springer Verlag, etc.
Estimation method – basic formulas:
V(Y) = ∑ nh (1-fh) / (nh-1) ∑ (ehi. - eh..)2
ehi. = (∑ whij (yhij – Y)) / w...
eh.. = (∑ehi.) / nh
StdErr(Y) = √ (V(Y))
with
nh : number of PSUs in stratum h
fh: sampling rate for stratum h
whij: sampling weight for observation j in cluster i of stratum h
yhij: observed values
13.2.1. Sampling error - indicators
Precision estimates for the question "Individuals having ordered goods or services for private use over the internet in the last 12 months" (individuals who ticked 'Within the last 3 months' or 'Between 3 months and a year ago' in in the question “When did you last buy or order goods or services for private use over the internet?”):
- Number of respondents (absolute value for ‘Yes’ answers): 1336
- Estimated proportion (in %): 59.7
- Standard error (in percentage points): 1.4
Details of the breakdowns are available in document Standard errors - Mandatory - Optional questions_RS - 2024 in the Annexes below.
13.3. Non-sampling error
See more details on non-sampling error below.
13.3.1. Coverage error
Information not available
13.3.1.1. Over-coverage - rate
The sampling frame is based on the data from the Population Census conducted in 2022, which includes households living on the national territory.
Sampling frame is not updated and there are the cases that dwelling or household does not exists at the selected address, or it is used for work, or there is not target person in household etc.
13.3.1.2. Common units - proportion
Not requested in the ICT survey.
13.3.2. Measurement error
- Measurement errors: Errors are eliminated with good interviewer training and their deep understanding of the questionnaire, aiming at spotting the errors during the interview and correct them, or if there is any error seen during the checking to call the household again and correctly collect that data that is needed.
- Questionnaire design and testing: Questionnaire is designed by Eurostat and adopted fully, there is no differences in design. Testing of the questionnaire is done before starting the survey. It gives insight on the complicated formulations of possible misunderstandings of some questions in order to reformulate the wording in national language.
- Interviewer training: Training of interviewers is done in a couple of phases which cover methodological training and understanding of all concepts that will be among possible answers. The next phase is going through questionnaire with explaining of every question and all answers. The last phase is technical training in the programme they will work on.
- Proxy interview rates: Not applicable.
13.3.3. Non response error
Information about non-respondents: No information available
13.3.3.1. Unit non-response - rate
The unit non-response rate is the ratio of the number of in-scope non-respondents (= number of rejected interviews) to the number of eligible elements selected from the sampling frame.
Unit non-response rate for
- Households: 20.1
- Individuals (aged 16-74): 20.1
13.3.3.1.1. Unit non-response – sample sizes
| Number of households | Number of individuals (aged 16-74) |
Number of individuals (< 16) |
Number of individuals (> 74) |
|
| Gross sample [A]The number of households/individuals initially selected from the sampling frame (if not applicable, indicate why below the table) | 3500 | 3500 | ||
| Ineligible: out-of-scope [B] For example, when a selected household is not in the target population because all members are over 75 years old or when no dwelling exists at the selected address, or a selected individual has died between the reference data of the sampling frame at the moment of the interview. | 211 | 211 | ||
| Number of eligible elements [C]Gross sample size corrected of the ineligible cases | 3289 | 3289 | ||
| Net sample size or final sample [D]The net sample size (or final sample) corresponds to the number of households/individuals that can be used in the final database. | 2628 | 2628 | ||
| Unit response rate [E] = [D] / [C]The unit response rate is the ratio of the number of in-scope respondents (= the number of achieved interviews or the net sample size) to the number of eligible elements selected from the sampling frame. | 75.08 | 75.08 |
Comments, if any:
13.3.3.1.2. Unit non-response – methods, minimization and substitution
- Methods used for dealing with unit non-response: Scheduling of phone call in time that is suitable for household.
- Methods used for minimizing unit non-response: No imputations are done.
- Substitution permitted: No.
- Substitution rate (in %): Information not available.
13.3.3.2. Item non-response - rate
Items with low response rates (observed rates in %): No low item non-response
13.3.4. Processing error
Information not available
13.3.5. Model assumption error
Not applicable
14.1. Timeliness
Date of data dissemination at national level: Data are disseminated at national level on 25 October 2024. Release date was done accordingly to the release calendar.
14.1.1. Time lag - first result
Restricted from publication14.1.2. Time lag - final result
Restricted from publication14.2. Punctuality
0 days
14.2.1. Punctuality - delivery and publication
0 days
15.1. Comparability - geographical
There is no problem of comparability across the country’s regions.
15.1.1. Asymmetry for mirror flow statistics - coefficient
Not relevant
15.2. Comparability - over time
Possible limitations in the use of data for comparisons over time: No limitations
15.2.1. Length of comparable time series
The length of comparable time series depends on the module and variable considered within each of the modules of the survey.
15.3. Coherence - cross domain
Not applicable
15.3.1. Coherence - sub annual and annual statistics
Not applicable
15.3.2. Coherence - National Accounts
Not applicable
15.4. Coherence - internal
All statistics are coherent within the dataset provided by the country.
15.4.1. Survey questionnaire – mandatory questions
MANDATORY questions in the Eurostat model questionnaire 2024:
Table 15.4.1. of document Standard errors – Mandatory – Optional questions_RS – 2024 in the Annexes lists the questions for which the coverage of subjects and characteristics reflected in the national questionnaire differs from Annex 2 of the Commission Delegated Regulation (EU) 2023/1797 of 7 July 2023.
15.4.2. Survey questionnaire – optional questions
Adoption of OPTIONAL questions and items in the Eurostat model questionnaire 2024:
Table 15.4.2. of document Standard errors – Mandatory – Optional questions_RS – 2024 in the Annexes lists the optional questions from the annual Eurostat model questionnaire 2023 included in the national questionnaire and their coverage for age groups beyond the standard scope.
15.4.3. Survey questionnaire – additional questions at national level
Additional questions introduced in the national questionnaire in 2024:
1. Do you have access to the following devices in your home:
- PC;
- Laptop;
- Tablet;
- TV;
- Radio;
- Mobile phone.
2. When did you last use computer:
- In the last 3 months;
- Between 3 months and one year;
- More than a year ago;
- Never.
3. How often did you use computer in the last 3 months:
- Every day or almost every day;
- At least once a week;
- At least once a month;
- Never.
Details of the questions are in document National questionaire RS_2024 available in the Annexes below.
15.4.4. Survey questionnaire – deviations
Effects of deviations from the routing used in the Eurostat model questionnaire: All statistics are coherent within the dataset
17.1. Data revision - policy
No information available
17.2. Data revision - practice
No information available
17.2.1. Data revision - average size
Not relevant
18.1. Source data
The source of the raw data is described with more details in the paragraphs below.
18.1.1. Sampling frame
Short description: The sampling frame is based on the data from the Population Census conducted in 2022. which includes household living on the national territory.
Type of source: The sample is not drawn from another survey sample
Survey vehicle: Stand-alone survey
Survey participation: Voluntary
Shortcomings: There is not known shortcomings
18.1.2. Sampling design
The sampling design is a probability design.
The sample is based on two-stage stratified random sampling design. Primary sampling units are enumeration districts and second stage units are households.
Enumeration areas, as primary sampling units, are stratified by the type of settlement (urban and other) and by territory at the NUTS 3 level (25 areas). Census enumeration areas are primary sampling units. From the Census 1981, there were applicable legal criteria by which the settlements were categorized as "urban" and "other". Urban settlements are considered those settlements which are declared based on rules or decisions of competent authorities in the Republic of Serbia, that is "Decision of the Municipal Assembly". Urban area is the sum of urban settlements. The rural area is the sum of the settlements categorized as "other."
Systematic sampling with probabilities proportional-to-size with stratification effect
Number of individuals interviewed in the household: One.
18.1.3. Net effective sample size
Restricted from publication18.2. Frequency of data collection
Annual
18.3. Data collection
- Methods used to gather data: CATI.
- Short description of the survey method: Telephone interview.
- Variables completed from an external source: No variables have been completed from an external source.
18.4. Data validation
Data quality checks are done by manual revision of questionnaires and procedures of logical control. Collected data are first checked and verified during the process of data entering. After that quality checking is carried out by using a set of strict manual and electronic logical and calculation controls. Reports that fail to meet the quality standards are subject to verification and are corrected as required.
Obtained results from the actual reporting period are compared with the previous and the corresponding reporting period of the previous year. If inconsistencies are detected the data must be verified at micro level again by using raw data of the questionnaire and possibly changed.
For logical control and corrections of errors is used Integrated Survey Tool (IST). IST is a software package that includes the process of data entry, logical control and production of output tables.
18.5. Data compilation
SORS does not perform imputations
18.5.1. Imputation - rate
For the target indicator "Individuals having ordered goods or services for private use over the internet in the last 12 months" (individuals who ticked 'Within the last 3 months' or 'Between 3 months and a year ago' in the question “When did you last buy or order goods or services for private use over the internet?”:
- Imputation rate (% of observations): Not applicable.
- Imputation rate (share of estimate): Not applicable.
18.5.2. Use of imputation methods
Methods used to impute item non-response: Not available.
18.5.3. Grossing-up procedures
Grossing up procedures have been applied to Individuals and/or Households: Households and individuals
Description of the weighting procedures: The household weight was calculated as a product of initial weight as result of sampling design (product of inclusion probabilities from each stage) and correction factor for non-response. Then the weights were adjusted to the estimated number of the households in 2024. The individual weight was calculated from household weight by adjustment to the population values, obtained according to the demographic estimates based on the vital statistics for 2021. Post-stratification was performed according to the gender, ten-year age groups and education (three groups) for the level of Serbia.
18.6. Adjustment
Not relevant
18.6.1. Seasonal adjustment
Not relevant
The EU survey on the use of ICT in households and by individuals is an annual survey conducted since 2002. In Republic of Serbia, it has been conducted since 2006.
In 2024, the survey collects data on the access to information and communication technologies (ICT), on the use of the internet, e-government, e-commerce, as well as green ICT.
The survey is collecting data of internet users, individuals who have used the internet in the three months prior to the survey.
This annual survey is used to benchmark ICT-driven developments, both by following developments for core variables over time and by looking in greater depth at other aspects at a specific point in time. While the survey initially concentrated on access and connectivity issues, its scope has subsequently been extended to cover a variety of subjects (for example, the use of internet, e-government, e-commerce, internet of things and green ICT) and socio-economic analysis (such as regional diversity, gender specificity, differences in age, education and the employment situation). The scope of the survey with respect to different technologies is also adapted to cover new product groups and means of delivering communication technologies to end-users.
For more details on the methodology applicable in each survey year, please consult the Compiler's Manual for the respective year.
Deviations from standard ICT concepts: No deviations
Households and Individuals
In the ICT usage survey, the target population for the different statistical units is:
- individuals: all individuals aged 16 to 74;
- households: all (private) households with at least one member aged 16 to 74.
Target population composed of households and/or individuals:
- Number of households: 2379115
- Number of individuals: 5020228
All households and persons referring to the “usual population’’ that reside in the territory of the Republic of Serbia, without Region Kosovo and Metohia.
For most questions the reference period is the last three months before the interview. Questions in the modules on e-government and eID refer to the 'last year' before the interview.
Deviation from this statement: No deviations
Information not available
Percentages of ‘Households’ and Percentages of ‘Individuals’
SORS does not perform imputations
The source of the raw data is described with more details in the paragraphs below.
Annual
Date of data dissemination at national level: Data are disseminated at national level on 25 October 2024. Release date was done accordingly to the release calendar.
There is no problem of comparability across the country’s regions.
Possible limitations in the use of data for comparisons over time: No limitations