Ladies and gentlemen, please take your seats. The session will start immediately. Our next session is about current and future work on an ICT household indicator. And I would like to give the floor to the moderator, to Alison Gilwald, the Executive Director of Research ICT Africa to moderate the session. Thank you. Thank you very much, Chairperson. Thank you for everybody getting back a little earlier. This section also looks at the current and future work of the ICT household indicators. While the previous session was looking more with the administrative data and the supply side data, this section begins to look at the demand side data through the ICT access and use surveys of households and individuals. And the work that's already been done in a number of countries on collecting data through national household surveys. I think what has become clear over the last few years and the work that has been done in this area already is that it's really through this demand side work, demand side survey understanding that we are able to identify the actual points of intervention. The supply side data can let us identify where some of the problems are. But from a policy point of view, how we can fix those problems really requires an understanding of the ICT access and use, what is causing those problems. So I think this demand side work is extremely exciting. We've got people on this panel who've been doing very, very exciting work in that area. And hopefully we'll be able to share these experiences in order to better identify the problems that we face. As we indicated, particularly in the global south a lot of the access to voice and also broadband services has been made possible through mobile networks, through mobile services. So the focus of this session will also examine or target or look at the issue of household and individual use in relation to mobile cellular services. So basically we'll start with a paper that will look at the outcome of the EGH, the expert group on ICT household indicators, the work that was carried out to 2014, including the discussion on proposed indicators in the area of internet security, child and youth online prosecution, barriers to internet use and mobile phone ownership. And then as I said this session will focus particularly on mobile cellular services. I think it's become clear from the first round of research that once one has issues of connectivity and access dealt with the real challenges, the real constraints on broadband use and equality and evenness of broadband use and take up are really determined by a lot of the, in our sort of view, softer factors but really far more fundamental factors that require policy interventions across a much broader range of areas than just ICT. So I think our initial work is all showing that issues of income which are attached to issues of education are actually the key constraints as you move into more complex forms of communication requiring higher skills levels. But let's hear more on that. Our first speaker has been doing very exciting work in this area. Alessandro, can you find your, sorry, full bio which I've misplaced here. Barbosa is head of the Centre of Studies for Information and Communication Technologies in Brazil which was recently recognised as a UNESCO Category 2 centre which is very exciting and a great reflection of the work you've been doing. The centre is for the development of the Information Society and it's based in Sao Paulo, Brazil. Mr. Barbosa is in charge of nationwide ICT survey projects in Brazil aimed at the production of ICT related statistics and indicators. He has more qualifications that he needs for the job and so I'm not going to go through them all, they're all in the bio. Please take us through your presentation. Thank you, Alisson. Good morning, everyone. It's a pleasure to be here with you this morning to share the outcomes of the EJ8 Group, Expert Group. We had a very interesting panel in the last session related to demand side indicators and now we are going to look, sorry, a previous session on supply side indicators and now we are going to look at some indicators from the demand side which is, as Alisson has mentioned, very important for policymakers. Well, I will start with a very brief overview to remember you that the Expert Group on ICT household indicator was launched in May 2012 and since then we have been very active in the discussion. The main objective of this Expert Group is to conduct a continuous revision on the partnership call list of indicators on ICT access in households and used by individuals, of course, in collaboration with our state members or member states and we have adopted mixed mode work methodology with online discussion on the EJ8 Forum and also face-to-face meetings. Today is our third report on the WTIS. The first one was in 2012 in Bangkok. Then we had another one last year in WTIS in Mexico where we had also the launch of the new version of the ICT household manual which is much more comprehensive and a lot of information and today is our third report in this symposium and we had two face-to-face meetings. The first one was last year in June in Sao Paulo, Brazil and our second meeting which was a joint meeting with the ICT was held in Geneva in September this year. We started with about 45 members, some of whom participated in the forum and 97 registered members in 2012 and today we have 99 countries, almost 100 countries and more than 300 participants in the forum so for those in the room that are still not registered in the EJ8 online forum I would invite you to join us. The meeting that we had in Geneva had the objective to examine the contributions received from the members of the EJ8 between July 2013 and September 2014. In this meeting in September we had 85 participants representing national statistics office and SOs, ministries, regulators and international organizations and regional organization and as well private sector. In this now I'm going to show you the main outcomes of this second meeting. We have eight points to be covered today very briefly. We had made some progress in reaching agreement on some indicators and other indicators are still open for discussion because we were not able to achieve an agreement due to the complexity of the subject like security, child online protection. So the first one was internet by type of portable device and network user to access the internet. Internet security was the second one, then child and youth online protection, mobile phone ownership, mobile phone activities various to internet used by individuals, ICT employment and we also discussed the future work of the EJH. Let's start by the first indicator that we have reached an agreement which was the internet by type of portable device and network use it. The participants and member states agreed on their definition and also the response categories for this particular indicator and ITU will include this indicator in the ITU, ICT household questionnaire. And to give you an idea of the type of device that we have made an agreement, we had four types mobile phone, tablet, portable computer, laptops, notebooks, and netbooks, et cetera, and other portable device such as game consoles, watch, e-book readers, et cetera. And for each of those response categories we have, if you have yes for that particular portable device to access the internet, we also have the type of network. So if yes, you have via mobile cellular network like 3G and 4G or via other wireless networks such as Wi-Fi. So those are the types of portable device and type of network used to access the internet. Internet security. This is a very complex issue. Members, they agree that this is very relevant for policymaking, but it is very difficult to collect. So those countries willing to collect this data, they are welcome to collect and to use the proposed questions proposed by ITU or other type of questions such as those in the Eurostat survey model questions. And ITU will not include these particular indicators in the ITU, ICT household questionnaire. And of course that many countries have sets installed in their country. They can use data and they may have different source of data for policymaking proposed in the local context. Another indicator that countries agree that it is very relevant for policy, but it will not be included in the questionnaire is child online protection, child and youth online protection. Although it is relevant, it is very complex to be measured and some countries are already collecting some data on this field. And we had a very interesting presentation from Iran. Iran made a real data collection using ITU proposed questions and they made a very interesting presentation and they also reported issues related to the difficulties. On measuring this, Brazil is another example that we also made a presentation in this face-to-face meeting. We are collecting data based on the Eurostat Kids Online Survey model for the third consecutive year, but it's very difficult. We agreed that it should not be included in the ITU questionnaire. Next progress that we made was related to the indicator on mobile phone ownership. We recognized that the indicator on the proportion of individuals who own a mobile phone is relevant for policymaking and for analysis related to gender to understand in different contexts like in South America context, African context, the difference between the usage and ownership by men and women. And it is important to mention that these indicators are different from mobile phone users and mobile phone subscribers. In the next slide, it will be more clear. And this indicator was agreed with Member States and it will be included in the ITU household questionnaire. And to give you a more precise definition on the ownership, the definition that was agreed is ownership refers to an individual who owns a mobile cellular phone if she or he has a mobile cellular phone device with at least one active SIM card for personal use. If you have the SIM card but don't have the device, it does not count. So we also agreed that mobile cell phones supplied by employers, for instance, can be used for personal reasons is counted as ownership. Also, individuals who have only active SIM cards and not a mobile device, they are not counted and they are excluded in these indicators. Individuals who has a mobile phone for personal use that is not registered under he or she, his or her name is included, is counted. So if you have a teenager in your family that has a mobile phone under a subscription of his father or mother, it will be counted. Mobile phone activities. This is another important indicator but although several countries is measuring already mobile phone activities, this will not be included in the ITU questionnaire. And the discussion of this particular indicator will be closed in the forum and countries can collect data for their own internal and policy proposals. The next indicator is barriers to Internet used by individuals. The indicator proportion of individuals not using the Internet by type of barriers is very important for many, many countries where we still have cost barriers and also availability barriers. So for policy making proposed, it is very relevant. And we have to ensure that response categories of the indicators barriers are not used on the Internet are complementary for the existing H814 indicators. And the discussion in the forum continue the discussion in the forum, online forum elaborating the response categories coming from this meeting. Review in the future the response categories of H814 which is complementary to this one to ensure that it refers only to household barriers. Another topic that was discussed, we had a very interesting presentation from ILO that has highlighted the increase demand from the industry makers for data about ICT and employment. So this is new. We know that we don't have comparable data at the international level and this was the start of this discussion. And since this is a new topic, it will be open in the online forum so that countries can encourage this discussion and bring their contribution so that we can reach an agreement in the future about ICT and employment. Well, another topic very, very important is related to data quality and this afternoon we have a very interesting section on this particular issue and I would like to remind you that the ongoing work to access data quality of ITU statistics and to develop a data quality assurance framework was welcomed by our participants. ITU is on the process of developing this data quality assurance framework and we have already a document that is posted in the forum. It was posted, I guess, a week ago or four days ago. It's available for you to have the draft of this document. The draft document is on the forum but also we have already created a discussion item on data quality on the forum. You can already start making your contributions. We know that many countries are working on data quality issues and finally I would like to point out the future work that we are doing in the future. We have a list of topics that were brought by participants. The first one, as I mentioned, was ICT and employment. This is a very important issue not only for developing economies but also for developed economies, job creation and job destruction so this is very important and this is a new item for developing economies. This is a very important issue. The indicator of proportion of individuals not using the internet by type of bearers must be revealed in the light of the existing age age 14. Also, it was suggested that countries should share experience related to internet security and also data quality and also methodological issues related to data collection tools, processes, standards, etc. And finally, still in this methodological issue, data verification, data processing, data dissemination like, for instance, data visualization tools. How we are going to present the data for a long time and easily handle this massive database of indicators and also open data. Other source of data, we had many presentations on big data yesterday and today. National coordination was another topic that was suggested as a future work for age 8. Bearers to mobile phone ownership and others such as sustainable development goals, 2015 digital inclusion, e-waste, e-government, e-health, ICT and education. So those were the topics that were suggested for the continuation of the age 8 online forum. And finally, I would like to reinforce the invitation for those countries that are not age 8 forum to do so. Here you have the web address. So you are welcome to join. This is my presentation. Thank you very much. Thank you very much for that, Alexandra. I think you've highlighted the importance of us refining our understanding of particularly mobile ownership and usage and certainly thrown out a challenge in terms of other areas that we haven't clarified that are already clearly factors that determine various groups' participation with ICTs. I think particularly education is going to be a challenge for us there. And of course link to these income and employment factors as well. Thank you very much indeed for that. The next presentation is a joint presentation by Esperanza and she is a member of the ICT data and statistics division at the ITU. She has been working in this area at ITU for a long time and prior to that worked in the ILO. Again, I think you can look at her bio if you want to track what she's been working on but she's been particularly active in the ITU and she's been working with the expert group on ICT household indicators and was responsible for developing ICT and the database. She'll be presenting with Josh who is senior manager at GSMA intelligence and this is a nice collaboration and trying to refine how she sits on through its operators. Nice to have access to that. Josh is senior manager as I said for GSMA intelligence. He has worked in the industry with consulting firms prior to that and has a lot of experience in this area which he will bring to us today share with us in the presentation. Thank you very much. Thank you very much Madam Chair. Good morning everyone. So this morning we will present some of the information that we are planning to embark on related to improving mobile phone metrics. So we have heard earlier that we have already looked at the issue of unique mobile phone subscriptions when the EGH chair presented the outcomes of the work that has been done in September and we would like to explore the current indicator on mobile phone that we are collecting at the ITU. So as you can see from this chart this is the one that you have in the measuring the information society report which is also available in our website. The upper line which is the blue one shows you that there is almost 96% of mobile telephone subscriptions per 100 inhabitants but this is not necessarily telling the real picture because what it tells us here is that almost all the population has a mobile phone subscriptions but this is not correct and that is why we want to check on other indicators that could better measure and show us the real uptake of mobile phone service. We can see also from this chart that the developing world has increased its share in terms of mobile cellular from 2000 to 2014 and majority of the mobile phone subscriptions are now in the developing world but this is not necessarily again telling us the real picture on whether the developing countries are actually using or whether there is a real this much uptake of mobile cellular subscriptions. So the current indicator that we measure and that we collect from our respondents from regulators and ministries is called the mobile cellular subscriptions and we used to call it mobile cellular subscriber and I think it was until early 2000 when we started thinking of whether we can still use this indicator as a good indicator of showing mobile phone uptake and later on we changed the name of indicator to mobile phone subscriptions. The main reason is that the numbers that we collect from countries are not any more subscribers but really the number of SIM cards or subscriptions which can refer to one person having multiple SIM cards or multiple subscriptions. So this is the current indicator that we have but this as I mentioned does not necessarily measure the number of people or how many people have a mobile phone or how many people are using mobile cellular services. So if you look at the indicator this is one indicator that was presented to us in the EGH meeting in September this is called unique subscribers this is an indicator which will show you that a person can equate to either one subscription or a subscriber can have one subscription or it can have more than one subscription so it looks at the number of person who has a subscription so a person has a subscription or multiple subscription. We also have an indicator which is called users and this is different from mobile cellular subscriptions because a user may or may not have a subscription or may have multiple subscriptions and this indicator is very important because this is really how we can see whether a person is really using a mobile phone and this is an indicator that we currently collect from the household survey that we collect from national statistical offices. So again this is not the same as mobile cellular subscriptions. There's a third indicator which is mobile phone ownership this is an indicator we discussed in September in the EGH meeting that we conducted and we heard earlier the definition of a mobile phone owner which is a person which can either own one or more than one mobile phone or mobile subscription. So this again is a different indicator from a mobile phone subscription indicator that we currently collect. So all of these three indicators we are not yet collecting and this is some of the areas that we would like to explore with GSMA intelligence whether we can collaborate to improve the current data collection and the current data availability that we have at the ITU. So for most of you know what we do in terms of ICT statistics so we collect data from both coming from the regulators and the ministries on the administrative data the supply side data and we also collect data from the national statistics offices on the access to and use of ICTs by households and individuals. In particular the mobile cellular subscription indicated and the mobile broadband indicator that we mentioned earlier are collected from the regulators and the ministries. So a few countries a few developing countries that conduct the household surveys and this is still a challenge for most of the countries because although they collect the household indicators the household availability of computer and internet the indicator on the percentage of individuals using the internet is still a challenge for most countries as there is no information. So this is an area that the ITU is also working with countries and with the national statistics office. We conduct a number of trainings and workshops to help countries understand how to conduct a household survey but still there's an issue of resources and other challenges that countries face in conducting the household survey. We also heard about the issue of data that we are starting to look at especially on the mobile cellular operators that could be useful in terms of finding new alternative data sources in terms of looking at how many people actually use or what are the activities that are conducted while using a mobile phone. So these are the three big areas that we work on in terms of we will work on in terms of ICT statistics. The first two, of course, is our current work and we hope that in the near future we can also explore new data sources. I'm going to stop here. I'm going to pass on the floor to our colleague from GSMA Intelligence to give you an overview of the work that they do related to the same topic that I mentioned earlier. Thank you. So essentially what you see on that slide are some of the similarities between the work that the ITU is conducting and the work that GSMA Intelligence is conducting. So GSMA Intelligence is a massive database. We have around 26 million data points in one location online. So kind of tackling the starting to tackle the big data issue here. And this data is mainly looking at operator metrics. This data is reported by operators every month, every quarter, every year. And we look at every single operator in the world, every single technology, every single metric that they report. And that's from the supply side. And then we also do collect data from the demand side and we run consumer surveys as well. And we bring the two together to come up with unique research that I'm going to cover in a minute, but essentially those two points are similar to the work that the ITU is conducting and that's quite an exciting area to understand how we can collaborate with the ITU to improve the data that we have. Regarding big data, we are also looking into this area and only starting now to try and assess what can be done and what kind of opportunities are out there. So just showing here the methodology that we use starting from the bottom of the pyramid, we collect, as I mentioned, data from operator reports. We also harvest data from all the reports that regulators publish. So we cover like around 1,000 plus operators more than 3,500 networks. And the data at an operator level is aggregated at a country level, a regional level and then on top of that we then apply the figures that we collect from consumer surveys. Those surveys have been done last in January this year and looking at 44 countries with an equal speed between developed and developing economies. And these surveys helped us to derive the number of mobile unique subscribers, so they're exactly what Esperanza was describing earlier, trying to understand the difference between a subscription and a subscriber. So one key question that we ask in the surveys, how many SIM cards do you actively use and that SIM ratio is essential to understand the best way to derive the unique subscriber metric. And then the numbers are also aggregated and then we get unique subscriber numbers at a country regional level, global level and we started breaking that out by technology as well, so we want to understand out of the subscriber base how many of them are using mobile internet services and how many of those mobile internet subscribers are doing through via mobile broadband or via 2G. And the team of analysts that we have also forecast all of that to 2020, so we ran a lot of research and analysis on the predictions and market trends over the coming years. So looking at what we do with this data, essentially we what you can see from this graph is that when you look at the penetration rate based on subscribers not subscriptions, what you see that when a typical country in the developed world reaches this kind of 80% level then that's when penetration starts to slow down and there is quite a striking difference between the penetration in the developed region and in the developing region and what we what we do with this data is essentially try to understand what it would take for countries in the developing region to increase the penetration rate so there's a lot of work going on around digital inclusion, understanding the barriers to adoption, who are the subscribed, who are effectively the unconnected population, right? So understanding all the questions on coverage and barriers to adoption and so on. So we published recently a report on digital inclusion which used a lot of the data that we published and trying to answer those questions in details. Here is an example of the data that we hold for China and starting from the left to the right we start with the population number which comes from the UN and then we start debating the the question around what share of the population is covered by mobile networks so we try to talk about access to network here and then we try to understand the addressable population so trying to make the audience realize that not everyone in a given country can subscribe to mobile services that will always be a share of the population that will never subscribe so you can derive that by looking at age groups socioeconomic factors, there are multiple ways to do it but it's important to realize it so the penetration rate that we are working with should not top 100% because there will always be a share of the population that will not subscribe to mobile services then based on the survey we understand that in China for instance the average consumer holds 1.79 SIM cards each which helps us to derive the unique subscriber number based on the subscription number that is reported by operators and regulators so we try to assess that between urban and rural areas as well so this picture is just to show you the debate that is triggered when you start talking about the best way to measure real penetration in a country and then all the good work that can come out of it when you want to understand what is at stake behind it especially when you start looking into the end connected population and barriers to adoption then looking at the cooperation and the collaborative work we are looking to conduct with the ITU the first thing that we'd like to mention is the definition and methodology that's a very important point to us and as I mentioned we hold a lot of data and what is essentially accuracy of the data and data integrity so we identified a number of areas where we can improve in aligning the definitions in the methodology one of them is around the activity period that is defined in the subscription number and the other one is around the activity criteria within the mobile subscription a mobile broadband subscription number so those two are areas where we will try and align as much as we can and try to improve the quality of the data then going into the measure to understand mobile phone uptake and the difference between subscription and subscribers we'll be looking at producing new indicators on mobile phone uptakes and for that as parents I explained the three key indicators that we think are very important to understand the unique subscriber number the mobile phone owner and the user number so those are indicators that we will start discussing and debating what the best methodology would be and to that I'll pass it back on to Esperanza Thank you so the next area of proposed cooperation that we have is on improving the data related to the estimates based on the current data available at the ITU and GSMA intelligence so what we would like to do here is that we will compare in terms of our estimates in the absence of official data and the data that is currently available at GSMA to see whether we can come up with a better data for our country where we are struggling to find a real official data the next area of cooperation that we will look at is on improving data sources and this is very important because we will be talking about what is going on in the future and what is going on in the future and what is going on in the future really your GSMA intelligence is planning to conduct surveys so these are consumer surveys and it was previously done by private company and here what we want to explore is working with national statistics offices in making sure that the surveys work with them in defining the sample to make sure that the sample that will be used in the future surveys of GSMA intelligence is representative of what the country is currently projecting there is also an agreement to look at using the internationally agreed standards and indicators that the ITU produce particularly on the household ICT indicators and this is one important area because this will ensure that the data we produce in both agencies are in conformity with international standards and are comparable for a given country we would also explore synergies in terms of big data as mentioned there's work going on in GSMA related to big data coming from mobile phone operators and we will look at in terms of how we can collaborate in doing this work we are also hoping to prepare a joint publication or maybe a joint chapter in terms of disseminating the results that will come out of this cooperation so it can be maybe touching on the new indicators or maybe the results that will be coming up from the household surveys that will be conducted in the future by GSMA and of course we will be happy to see the results of the GSMA in terms of the data that will be collected using the household surveys that they are planning to do in the future and we will compare the results with data that are available at the country or we will probably explore how we can use this data to supplement the current data that we have on ICT household statistics and we will explore using this alternative data or the data that will be coming out of this cooperation in the absence of official data and this is of course to ensure that there is a wide availability of ICT household statistics and that we don't rely on estimates that are based on other indicators that are not necessarily collected from household surveys I think that's it I just want to mention that we have a few copies of the publication of the ITU household manual and the ITU handbook on administrative indicators we put them outside so if you don't have a copy of those publications you can pick that up after this session, thank you Thank you very much Esparanza and Josh Thank you, I think that's really highlighted the challenges we face in getting complete sets of data and the importance of complementary data in finding a fuller picture and understanding where we need to address problems I do think it also highlights the incredible need for full demand side studies in order to really understand what's happening on the ground and I think a lot of the evidence that is available has where there are demand side studies have been shown to reflect some of the problems with just using descriptive statistics and without nationally representative demand side surveys you simply unable to go into the modelling that can take you beyond those descriptive statistics I think an interesting case in that regard is the work that we've done on gender for example that in purely statistical terms demonstrates as one anticipates in many countries particularly with regard to the internet they reduce the inequitable use between men and women in favour of the internet whereas when you begin to model that with nationally representative data you actually find that the determinants of that imbalance is not gender per se but actually income and education and that women are concentrated in those lower groups so from a policy point of view that's what you actually need to address not so much the sort of direct ICT gender sort of initiatives that many of these attempts have done to bring equality so it's a really big challenge for us let's move on in the interest of time we've got Alvina Kwan who's senior statistician at the census and statistics department in Hong Kong who's going to speak to us on this topic she is actually responsible for the development of statistics on innovation, ICT culture and creative industries so a whole lot of other interesting stuff as well again just look at her qualifications and her experience which are very interesting in the bio and if you could start your presentation we could move on to the questions hello everyone thank you very much for having me today to share about the experience of Hong Kong China in conducting household survey in collecting the demand side data on ICT use today I will focus on the barriers to ICT use I will start I will first start with a brief overview of the Hong Kong situation on the ICT use and penetration and then I will have a session on why household do not have PC and then finally and I will address to household internet access first I would like to talk about our data source we conduct a household survey every two years in details to collect data on ICT barrier in between we have a brief update every year for the key indicator for our survey we successfully interview over 10,000 randomly selected household and we target the respondent we target the household head or a knowledgeable person in the household about their ICT use and we use face-to-face interviews full household visits to collect our data and we can achieve a response way of over 75% which I think is really encouraging in this chart you will see the uptake of household in using PC and internet in the past decade in Hong Kong China you will see at the start of the decade less than half of a household using PC or internet apart from the average but in by the end of 2012 we have around 80% of household using PC and around 78% of household using internet I would say that the sharp growth in the past decade of using PC and internet in Hong Kong China are not a sharp increase indeed apart from the uptake of the PC penetration and internet penetration by the average household actively promoting the ITCU by introducing digital inclusion program specially target for the disability elderly student of limited means and ethnic minorities government will subsidize the funding for ICTSS and there are a lot of engagement program to promote their interest in using the ICT device I have been asked about the challenge in Continental household survey in Hong Kong I must say that we are relying more and more on technology in our data collection and we are starting using online questionnaire various computer device in our data collection I must say that our challenge is to capture those who left behind by the technology that means the remaining 10 to 20% hardcore non-PC and non-internet user that will be our challenge I notice that this is one of the topic in the EGH we are moving forward to a footfall discussion on this topic so that we can all together address this challenge then I will turn to my presentation on those household do not have PC first of four people always ask us what is the recommendation we have the EGH discussion we follow the recommendation from the expert group so that we can have universal standard of PC around the world within the ITC family and there is a strong here I just follow the ITU definition and in 2012 there is around 80% of household say that they have PC at home and among those the 20% who do not have PC at home and about they will definitely not to have PC at home in the near future and by looking at the reason for them not having PC at home and the first reason that comes to us is they do not know how to use computer and then they have no specific application these are more linked to the elderly disability student with the ethnic minority who have less understanding on the use of ICT and then in the middle causes another concern about 7.1% household say that only a PC is too expensive for them and by looking at the household income I must say that the accessibility to ICT really related to the cause about less than half of the household who earn less than 1,000 Hong Kong dollars that means around 1,200 US dollars they say that they do not own a PC at home so I must say that the ICT assets to a certain extent linked to the problem of poverty and then let me turn to the next part the barrier to household internet assets among those who have PC at home we ask those household whether you have access to the internet and almost all of the household who have PC at home had connected to the internet only around 2.6% say that they do not have assets to internet and among those who do not have assets to internet a quarter of them say that they will not connect to the internet in the near future the reason for them not having PC at home which connected to the internet I would like to echo yesterday's speakers view first of all the understanding of the benefit of access to ICT is really important because many of the household say that they think that they do not need to use the internet surface some of them say that they have lack of interest in using internet I think this related to their understanding of the benefit of using ICT and secondly it related to skills some of the household say that they just lack of the skill in using computer and internet application and finally at the end is about the cause of using ICT many of them saying that the monthly charge for internet are too expensive for them and by looking at the household income distribution we confirm our finding that to access to the internet we need funding for those household who earn less than $1,200 is the rate of connecting to internet is just about 35% that comes to the end of my presentation there is more information about our survey in our census and statistic department website we just finish our survey in 2014 about this barrier to ICT use and we will publish our results soon thank you very much thank you very much Alvinna I think many of us in the global south would love your problems you trying to collect the last 20% we are trying to collect the last 80% but very interesting and obviously really luxury of information and data there let's move right on because we are running out of time to Carmelo Munoz he is director of the national observatory of pro telecommunications and information society in Spain he's an advisor to the ministry again he's activities and experience are captured in his bios so please have a good look at that and some of the work that they have been doing in this area thank you good morning I'll do my presentation in Spanish good morning ladies and gentlemen I thank the UIT the invitation to the 12th edition of this WTIS and the opportunity to show some work that the national observatory of pro telecommunications and for the information society develops in relation to the points that I have been asked to deal with can we have some indication if we are going to get any Spanish to English translation alright we we are Spanish Spanish Spanish okay you can start please maybe to check this so good morning ladies and gentlemen I thank the UIT the invitation to the 12th edition of this WTIS and the opportunity to show some work that the national observatory of pro telecommunications and for the information society develops in relation to the points that I have been asked to deal with so do we have translation or still not so in English it doesn't matter it doesn't matter alright and we have English PowerPoint as well okay well good morning ladies and gentlemen I would like to thank to the ITU for the invitation to the 12th edition of these WTIS and the chance to show some points of the work that the national observatory of the telecommunications and information society develops in relation to the points that I have been asked for deal with the first of the points I am going to deal with is related to indicators of security in households last year the observatory ICT observatory was given competencies of observatory related to online security as the result of this we've adopted okay well the first of the points I am going to deal with is the one that refers to security indicators in households last year last year the national observatory of telecommunications and information society as the national observatory that is received the competencies of observatory in relation to online security the result of this we've adopted the work that previously carried out the national technology institute of communication consists of a study composed of 3,000 households in which a follow-up to the Malware activity of the different fixed and mobile of each home as it is carried out online to the individuals belonging to each home finally in those variables that the software installed in the homes is monitored a comparison is made between what the homes declare and what the software detects then data to homes in response to the following questions that appear on the screen about the use of automatic protection against threats when we talk about automatic protection we refer to anti-virus updates anti-virus updates of operating systems the use of pop-up the use of anti-span software and anti-spyware in response to these questions we extract the following data that we see on the screen you can see some cases as in the use of internet that the reality surpasses the declared what it has to think that in this type of cases the user is not aware not even that he is subject to a certain type of security measures from the next table we can conclude in virtue that the reasons for not using this type of protection is that they do not know or that they do not need there is an important unknown about the use and the importance of protecting against online threats passing the use of non-automatic protection as the use of the personal electronic identification or the use of the electronic signature the partition of the hard drive security copies or the elimination of temporary cookies and files it has made a similar type of questions evidently the more specific is the measure of protection the less its adoption in virtue of what can be seen in the graph that is shown on the screen what less adoption has the coding of data and documents it is something much more specific than changing a password in a similar way in the case of the automatic protection the non-automatic its non-adoption it has a lot to do with the users think that it is not necessary again to the same conclusion the unknown of the importance in the use of protection measures passing indicators passing indicators of use of mobility which is the second point that I wanted to try of the extracted data of the TIC-Hogares survey that is carried out annually and it is a professional of the INE it is about 24 million, almost 25 of Spanish between 16 and 74 years declared to have used the internet for the last three months of them 17 million approximately 70% declared to have used a mobile device out of the house or in the workplace the graphics located at the bottom of the screen is deduced that the mobile is the favorite device to navigate through the network that those who use the mobile do it more through a wide mobile and that those who use portable computers and tablets access the internet preferably through wifi obviously these were the results that should have been obtained logically because the smart phone exceeds mobility levels of tablets and laptops of the graphics that we are going to see in the future it is said that there is an approximate balance between men and women as mobile users and that we should be attentive to the digital breach that is being generated we see in the next graph that we should be attentive to the digital breach that is being generated in older people at the level of studies there is a certain balance between those who have only finished some of the primary education cycles and those who are owners of a university title of this graphic that we can see is concluded that the middle class is basically the most important of the most proportion of mobile internet users although if we subdivide by each of the categories we see that the high class is dominated by working situation that is those who dominate in the use of mobility and the most proportion of users Internet and mobility are the inhabitants of the big urban areas, the big cities or very small municipalities. In Spain there is also a large number of people with a reduced number of inhabitants. As for the use barrier to the internet, part of the citizens in the first picture, it is observed that 74% of homes with at least an individual of between 16 and 74 years have access to the internet. It is not despicable that 26% of residents mostly declare that the reasons why they do not have access to the internet are that they do not need internet, 60.6%, or that they consider not having necessary knowledge for the use of internet, which represents 38.6% of homes that do not have internet connection. This constitutes a call for attention to our government, given that it shows us the need to start acquisition programs of basic knowledge management of the network tools. If we want to reach a percentage of users close to European powers, such as the United Kingdom, France or Germany, to finish, I would like to treat the use of internet by children and teenagers, which I have left for the end of the intervention consciously. And I have wanted to leave it for the end, given that it has to do with a measure set in motion recently by the Ministry of Industry, Energy and Tourism of my country, which has constituted a working group of minors and internet, in which I coordinate one of its subgroups, Metric Studies and Technology Watch. The regime in which this measure is developed is the one of public-private collaboration, in which there are ministries such as the Ministry of Interior, Health and Social Affairs, Justice and Education and Culture, and a series of collectives of the civil society that work for the protection of the rights of the minors. Among the actions carried out by the subgroup that I coordinate, is the implementation of a diagnostic study of the use of mobility by minors. It would be a qualitative and quantitative study that would specifically address the use of mobility. And we have the very often occasions of mobile grooming and sexting and so on. And in the end, I would like to sum up my speech. As regards the safety in the internet, we have a lot of work cut out for us, meaning that the citizens must quite well comprehend how important it is to adhere to these measures of safety, very importantly when we are going to switch over to the digital systems. As regards the mobile telephone usage, I consider that it is worthwhile to pay attention to the category of the aged individuals, not to make them sort of secluded, separate from modern technologies. And in terms of the analysis of various internet using to single out that in terms of the fact that the price is high for these technologies, we don't have all the opportunity of installing and in terms of access, we don't have problems. We have the barrier in terms of cultural educational issue. That's why I would like to finish up my speech. Thank you very much for your attention. A lack of awareness around it, which I'm sure would be shared by many of our countries, be equally high. And of course, the very interesting and innovative work you're doing around child protection, and I'm sure that will be developed over the next few years within the group. I think because we are so short of time, we're going to go straight to some questions. We actually have kept within our time, but the time was late in starting. So let's give a chance so that we can get some feedback on these really interesting presentations. And I'm just going to start and move that way. So Indonesia, please. Thank you for your moderator. I'm from Indonesia. Excellent presentation from our panelists. Regarding to Mr. Berbo's presentation, I want to share what we do in Indonesia for collecting information about internet security. That we all know that the internet has become a high-value thing. Because it has high value, and the attacker or crime become interested in the internet. Okay. In Indonesia, we have organization called IDCC, something like Shorts or like Shorts, the function as a security incident response team on internet infrastructure. We do collect data which consists like a kind of event of security has brick. For example, a kind of event of security has brick is like SQL injection, something like that. And destination IP address of attack, Shorts and destination part of attack, and the protocol type of use for attack. So I want to share if we put it on the future ICT indicator on internet security. Thank you. Thank you. We'll just carry on, please, with the next question. Iran. Thank you very much for our live panels for the interesting presentation. Actually, I wanted to share some experience from Iran because in 2013, as mentioned by Mr. Babusa, we performed the household survey in Iran based on the latest manual of ITU. Just I wanted to mention about the barriers to internet access, I think. It is one of the most important questions in this survey, I think. Because also we can assess inclusion in that part. Our suggestion also is to separate access barriers to access and barriers to use because in some cases people have access but they cannot use because of the quality, because of the content, because for example also for disabled person they have access to the internet at all. But they cannot use the content because it is not usable. And this is where we can assess the inclusion because to see the people that have been excluded from access, from the use, in some cases they have the access but they cannot use because of the quality, because of the content is useless for them, they cannot find suitable content or suitable services for them. We did it, for example, in e-government survey that we asked people why they are using, you are not using electronic services. This is available. They answered that e-service is not available. I cannot find it on the internet. It is not usable for me. And this kind of, they have the access. So I think we should work on that to separate the access and use. For example, and also I wanted to mention because I found that in China, Hong Kong, China they have the same problem. In the response to this question, also 64% of the households that do not have access do not use the internet. They answered that we do not need the internet. It is very important. I found that also in your survey you have very close. In our analysis we reached to this problem that we should work on absorptive capacity to increase the capacity of people to understand, learn and apply the lesson about internet benefits and its capabilities. It is very important in the countries to work on that. And based on the result of this question we can find that also because I found that also in the Hong Kong this is the problem we should work on absorptive capacity to increase this capacity of the nation. Also, the other response categories was cost at the second stage, but also the cost of services and cost of equipment. At the fourth stage it was the skills or confidence or ICT skills. And I think also it shows that again ICT skills are a main barrier to access or using maybe using the internet, not accessing the internet. Thank you very much. Thank you very much Egypt. Thank you very much Madam Chair and thanks for this distinguished speaker. Actually my comments it's concerning the EGH and as well as concerning the presentation of GSMA and Esperanza. For the EGH for the security I really would like to stress again the importance of measuring this issue. Especially the cert in every country in our case they are waiting our work and they are waiting our measurement for the security. And I think this is also the case of many other countries. I saw it and even I saw it in the OECD the working party of information society last year which is there was a presentation from the people from the security working party and they looking for our work in this. So I would like to stress to have it again and to try to find measurement for this. Thanks for the mobile phone orange ownership by gender to be included because this is one of the important and especially I'm interested in this and in the gender indicator in general. For the barriers to internet use by individual we need to see the complementary between this indicator and the indicator number 14 HH 14 as well. This is my comments for this and concerning the GSMA explaining for doing survey with the NSO I would suggest as well to include because the cases in other countries it's the ministries or the regulator are involved with NSOs for the surveys like our case in our country we involve it in designing the methodology and the sampling with our NSO and the questionnaire is designed by our side so please we need this coordination as well with the other countries. Thank you very much. Thank you very much for that input. I know there's a lot that's been presented but if we could just focus on your point that you want to highlight and get to the end of the room. Bangladesh. My question to Alvina from China during your this household survey in China did you in your mother's use the computer-assisted personal interview system or just traditional paper-based interview system? In case you have used computer-assisted interview system what are the challenges or difficulties you have faced? Thank you. Thank you very much Chad. Thank you. I'm going to speak in French. I am the head of the statistics section at the office of regulation, telecommunications and at the same time the head of the observatory. My question is about the IT and GSMR. In fact, the multisim or the multi-utilizer is today a bias for the indicators. The question is to know if we can compare two countries without taking into account these phenomena. For example, when we take the number of users per 100 people in Gabon, it's more than 100% and in the chat it's less than 50%. Can we compare these two countries on the basis of these indicators? It's the same for the use of the internet. I can have the internet at home but my friends come and connect but we consider ourselves as one user of the internet. Sorry about that. The question was about multiple... Sorry, multiple sims and the question was directed to Josh from GSMA so I think he can handle the response in English. But not right now, we'll just take it on. I'm sorry we didn't get translation for everyone else but he'll capture the question in his response. China, please. Thank you, Chair. I also have some concern about unique mobile ownership measures. I think Geneva, I want to clarify it more. Then do this computation. As I understand, you have a premise that multiple sim cards hosted by one person is a reason to get a higher penetration rate. Then the more sim cards one person has, there is more likely we can see a higher penetration rate. When the less sim cards one person has, there is more likely we can see a lower penetration rate. So when we use the overall penetration rate in the numerator and use the average sim cards one person has in the denominator, the mixed results may have some bias. I think the solution to this problem is to find a steady relationship between sim cards hosted by one person and the penetration rate by some econometric model using the survey data and consider the model into the estimation process. In this process, I think some survey in city level or community level is needed. I also want to ask what is your data source for doing this research? What is your estimation method of sim cards hosted by one person indicator? Can you share it for us? Thank you. Thank you very much for that. I think the question around what demand side surveys can do that some of this other data can't, is that it can ask. We don't actually need even econometric modeling or regressions. You just say, how many do you have? 17 African countries that there was an average of 5, but very different in some countries 7 and in some countries 3. If you can do the demand side survey, you can get your answer straight. We'll come back, we'll get your questions directed to ITU, to Esperanza, and to Josh. Okay, thank you. Short question to a gentleman from GSMA. When you collect your numbers or information through your survey, do you go directly to the surface providers in each country? And if so, do you contact with the all surface providers or just the incumbent by overpassing the regulator? Because in the case of Saudi Arabia, the only source of the telecom numbers and information, it comes from the regulator.  Sorry, at the back and then, yeah. Yes. Azerbaijan Marketing Society. A question about the barriers for internet usage. Has there been an attempt to survey both randomly selected household member and the head of household or any other member of household who is the decision maker on internet usage and then to jointly analyze the responses to compare what is the real reality and what are the responses from randomly selected members of household. Thank you very much. We'll get, maybe you can answer that question as well. Ken front, and then we'll have to close. Thank you very much, very quickly. I have three questions. One is about the EGH work. So, Alexander, you have recalled the important work in revising the questions and the indicators. But my first question is, have you discussed in the EGH the possibility of having a repository of model questioners which is updated so that countries that want to include one new module can quickly have a model question. Second one is a question for Joss. You have mentioned that you would like to work with national statistical institutes. But my concern is that, for instance, in Europe, the work program of NSI is very much regulated by the community statistical program. So it's not so easy to introduce a new survey. On the other side, for developing countries, they have very scarce resources and very high demand, very high pressure on international organizations to produce data on many other topics. So how are you planning to coordinate with national statistical institutes to have these new surveys including national statistical programs? And my last question is for my country fellow, for Carmelo. You have mentioned the different studies carried out, but one of the major issues in Spain right now is the high unemployment of the young population. Have you carried out any kind of study about the relationship between the use of ICT and the ICT skills and the impact on employment probabilities? Thank you. Sorry, there was a question from Sweden earlier on, but otherwise it is closed off because we are completely out of time. Does Sweden still want to comment? Yes, no? Thank you. Thank you, Madam Chair and all of you for all the interesting presentation. I would just like to inform you quickly that we now in Eurostat in the task force are working with some specific field of the internet security and its privacy and protection of personal identity and it's very much a work in progress at the moment, but there will be a finished module in March next year and we are now working with the purposes of providing personal information what the purposes are for the users and have they done anything to control their personal information and so what have they done and are they concerned about how their personal information are handled on the internet? So that was just for information. Thank you. Thank you very much. We are going to have to do a real whip around please to your points. Maybe just the main ones have been addressed to you and Joseph, you just make sure that you pick up the multiple sims because that wasn't translated for everyone. Thank you. I'll try not to forget every question about the question from Indonesia. I'll be pleased to share our methodology and our conclusions so we will be in contact and I'll send you every information. What else? About... Oh, yeah. Yes, we have surveyed and analyzed that is related to data from the works developed by our National Institute of Statistics and it's called a social demographic profile of the internet user and there we draw the profile of the high level internet users and the low level internet users and the factors involved in that situations in those situations. Thank you. I'm going to ask you to stop there so we can get one response to everybody and then if we have time, I don't think we have. Alvina, could you answer the question from Bangladesh? Thanks for your interest on my part because the question touch on internet security and I can tell you our survey in details. Thank you. I'll address the Indonesia question and Egypt question about internet security and I would like to let you know that this issue is open for discussion in the forum in terms of sharing experience and understanding to mention about Eurostat that is conducting a survey model and questions about internet security and as I made a point in my presentation, we suggest that countries follow some existing model like Eurostat model but we recognize and acknowledge that this is a very important issue and bearers to use. Also, this item is open in the EJ8 forum for sharing experience and also it is not going to collect this particular indicator but we do acknowledge that it is very important so I think that and lastly Jose Luis mentioned about mood questionnaire we are not tackling this issue but it is indeed a very good suggestion and I welcome your input to the forum and we can discuss this later on. Thank you very much. Thank you very much for all your questions I think I will just tackle them all together to say that the indicators that you mentioned on the barriers and security are all in the EJ8 forum and that you are very welcome to participate in the discussion in sharing your experiences there is also this idea of repository of household questionnaires and I would like to share with you that we are already also contacting countries to share with us their household questionnaire if they are willing to do so but I think this is also an important subject that could be also put into the forum so that countries can learn from the others in terms of the questionnaires. And lastly on the comment from Saudi Arabia and in Egypt in terms of having the official data sources that we currently have as the still the main source of the data that we collect I assure you that we will continue to collect the data from the regulators on the supply side data and on the demand side data we will get them from the national statistics offices and that in the conduct of surveys I'm speaking on behalf also of GSMA we will be working with the NSO and of course we will try to work with other agencies that are involved in the discussions regarding the surveys in the country. Thank you. Thank you for your question. The question was about data comparability essentially so if we are looking at a country like Ghana or Gabon with a very high penetration rate based on subscriptions how can we compare this country with a country like Chad where the penetration rate is very very different so if in Ghana the penetration is through the roof above 100% and in Chad the penetration is around 50% if the phenomenon of multiple SIM therefore making penetration based on subscriptions kind of irrelevant I think that was your question and that's typically the problem we are trying to tackle with this new methodology of coming with a subscriber number and when you remove this multi SIM phenomenon out of the subscription penetration rate then you get a number that you can compare with any country so when you look at the subscriber penetration for Ghana, Gabon or Chad then you have a number that you can compare and it's giving you a much better picture of what the real penetration is so this is absolutely the idea behind and the objective behind getting to a subscriber number rather than a subscription number Regarding the question from China I'd be happy to take you through the methodology and share the data as well with you if you want to see some of the details and if you can help as well to improve it and share any insights you might have that would be very helpful as well I think the survey numbers that we get do not come from the operator but comes from the man on the street so none of the operators are involved in the subscriber part of the research they are only involved in collecting the numbers for subscriptions and those numbers either come from operators or they come from the regulators reports in the case where operators might not report anything and just going back to Ross's question this is something we... the collaboration and the development of the survey and how to do it is something that we haven't looked in details yet but we'd be happy to take in inputs on how best to tackle all those issues Thank you very much please do follow up with those people that you've not been able to get your full answers from they're all here and they're available I think we have to close up the session which is highlighted and endorsed I think the work, excellent work of the expert group on household indicators which is defined new indicators that better reflect particularly on mobile phones I think the initiative to try and supplement and complement the lacking household survey data with the collaboration between GSMA and ITU with the big data... the big sets of data that they've managed to sit on from the operators is a very welcome development and hopefully will be complemented by the more household survey being undertaken by more countries I think particularly the barriers to ICT use has been very widely embraced by participants I think the realisation that we have to move beyond access and really understanding the factors that constrain use has been highlighted the future activities and the future areas for discussion have been identified please engage in the online forum and contribute to these and I think the other important thing that came up was the issues of internet security and there's obviously a lot of interest and Alexander has spoken about the intention to take that work forward and I think it's a great way to participate in the survey that includes the indicators and definitions on all of these issues and the other issues and I'll hand over to the chairperson please Thank you. Thank you to Miss Alison Ghiwot for the moderation of this session it was a very interesting session Magpantai, Alvina Guan, Carmelo Javier, Mujos Ruiz Now we have a lunch, we'll continue our session at 2.30 at 2 o'clock we have a site event which will present Oman's experience in conducting the ICT households and individual survey 2013 it will include also a presentation of survey methodology and results at 2 o'clock who will be interesting in this site event, it's not obligatory it's voluntary, you can join this event but for the next session which will be about data quality, big data and open data, we'll start at 2.30 Thank you very much and enjoy your lunch