NBE2011 conference in Salla, Lapland

This week I am at the NBE2011 conference in Salla, Lapland. This is a small conference that has a quite broad focus on social media and learning. We submitted a paper about the pedagogical design challenges of open online courses. In our paper we compared three cases: Composing free and open online educational resources course that I did with Teemu Leinonen in 2008, Learning Environments and Learning Networks course that I did with Terje Väljataga in 2010 and Learning and Knowledge Analytics course that I participated this year. Our paper is published in the conference proceedings:

Väljataga, T., Põldoja, H., Laanpere, M. (2011). Open Online Courses: Responding to Design Challenges. In H. Ruokamo, M. Eriksson, L. Pekkala, & H. Vuojärvi (Eds.), Proceedings of the 4th International Network-Based Education 2011 Conference The Social Media in the Middle of Nowhere (pp. 68-75). Rovaniemi: University of Lapland. [Online]

One of the reasons for coming to NBE conference was to see the beautiful summer in Lapland. I came here with four of my colleagues and we had a nice car trip through the Finland. Salla is a little bit north from the arctic circle and it is currently the time of polar day. Unfortunately the weather is cloudy and we can’t see the sun during nighttime. Salla area has more reindeers than people. I have already managed to capture one of them on the photo.

Posted in Conferences, Presentations | Comments Off

ITK 2011 conference and updates about EduFeedr

Two weeks ago I participated the ITK 2011 conference in Hämeenlinna. This is the largest e-learning conference in Finland with approximately 1600 visitors. For me it was fifth year in a row to participate ITK conference.

My main aim was to present EduFeedr to Finnish audience. As more educators are trying to use blogs and social software instead of a learning management systems, tools like EduFeedr become handy. There have been 19 active courses and several more tryouts in EduFeedr since we launched the beta service last September. The best example in English is New interactive environments, but the largest course is actually in Spanish (Innovación abierta en la gestión de proyectos culturales with 61 participant blogs). In addition to English (2) and Spanish (2) we have courses in Estonian (11) and Finnish (4). Here are my abstract and presentation slides from ITK.

We planned to release a version 0.6 before the ITK conference but unfortunately we didn’t manage to do that. The main features that we have planned for EduFeedr 0.6 are described in EduFeedr blog.

On the second day of ITK we had a joint video conference session with Estonian e-learning conference that took place in Tartu. From the Estonian side my colleague Mart Laanpere was talking about the development of digital learning resources by vocational and higher education teachers (PDF). From the Finnish side Ville Venäläinen and Tarmo Toikkanen presented the Sometu network. Twitter hashtag #itkesitys178 was used for short comments from the participants in both sides.

Most inspiring presentation for me was the keynote speech by Pierre Dillenbourg. He presented several “modest computing” experiments where they used simple physical objects with simple sensors/displays in the learning setting (video). Although I am now able to follow presentations in Finnish quite well I was most of the time in the English session. There were two open education related presentations by Kati Clements and Anna-Kaarina Kairamo. An interesting discussion followed Jukka Huhtamäki’s presentation about the Knowledge Federation initiative.

Teemu Leinonen presented three design concepts that our research group in Media Lab Helsinki has developed in iTEC project. TeamUP, PLATES and ReFLEX that are designed for supporting study projects where students work in small groups. These applications help to divide students to small groups, follow their work, manage/share media and reflect on the learning experiences.

Teemu Leinonen presents iTEC project

I hope that next year the Estonian and Finnish e-learning conferences don’t take place on the same days. Then there could be more visitors and presenters from the neighboring country in both conferences.

Posted in Conferences, EduFeedr, Presentations | Comments Off

Late thoughts on the Open Ed 2010 conference

Last two months have been so busy that I haven’t written anything on this blog. There is one blog post that I planned to write already weeks ago. It’s a summary of the Open Education 2010 conference that took place in Barcelona. Several participants have already shared their thoughts about the conference: Ismael Peña-López, Molly KleinmanJohn Robertson, Brian LambScott LesliePieter Kleymeer, Paul Stacey and Vic Jenkins. There is also a wiki page and a Cloudworks site about the conference. In my post I want to point out some of the presentations.

One of the keynote speakers Wim Westera talked about the next steps in OER strategies (presentation). On of the important issues that must be solved is the financing model. Westera argued that micro pricing model where people pay for views or downloads doesn’t work in education. Instead of that we should look at the cross-funding. He proposed 8 cross-funding schemes (see slide 30). In my opinion the most promising models are the freemium model and the rock concert model. We can see the freemium model working quite well in Flickr where the pro account costs $24.95 for a year. Some other services like SlideShare have failed to provide a reasonable price for ad-free accounts ($19 monthly). I wonder what could be additional pro services in LeMill that would attract active authors to pay a small fee that helps us to cover the hosting costs (detailed statistics about the use of their resources, management of exercise results, …).

Another keynote presenter Erik Duval was talking about removing friction in open education. His presentation made me think about large numbers. GLOBE has reached more 1 million learning objects. This is a great result, but what is behind that number? How many of these resources have a Creative Commons license that enables educators to improve and remix the resource? Are these resources somehow connected to the authors? In many repositories the resources are not published by the actual authors. I think that in case of user generated content it is important to maintain these connections. This is something that the OER community must work on. LeMill has 24 000 resources but unfortunately we have some technical problems with our OAI-PMH interface and these are not available through GLOBE yet. If we get this fixed then LeMill resources would make 2% of all OER’s available. Erik showed also an interesting comparison data from dataTEL initiative (see slide 50). We have to make LeMill data also available for dataTEL community.

From the conference presentations I really enjoyed Rory McGreal’s talk about approaches to OER course development (article). He listed 13 suggestions for developing OER course content. I find his suggestions very relevant for Estonian context. In recent years we have had several large project where lecturers develop online course modules. However, the quality of these modules varies a lot and often there are technical limitations for reuse and re-editing (source files not available, etc).

A lot of interesting things are going on in University of British Columbia. Brian Lamb, Scott Leslie and Novak Rogic presented how they use open platforms in UBC. One wiki installation is used for the whole university and integrated with university login system. This has allowed them to reach critical mass of people who collaborate online. They have even hired a wiki gardener to manage the site. Instead of developing their own platforms they rely on major open source platforms (MediaWiki and WordPress) and add/develop the needed plugins.

Another wiki-related presentation from UBC took place in Mozilla Drumbeat Festival. Jon Beasley-Murray talked about a course project where his students were writing Wikipedia articles. Three of the articles were finally featured on the Wikipedia main page. I should start improving the Estonian Wikipedia in my courses.

Brian Panulla and Megan Kohler presented an ontological model for exchange of assessment rubrics (article, presentation). I have experienced it in my own teaching that coming up with a detailed assessment criteria is more difficult than creating/finding/adapting the learning content. Many educators would benefit from a sharing platform of educational rubrics. Actually in Estonia we have a platform for creating and sharing rubrics for primary and secondary education. Estonian teachers have created more than 250 rubrics that are published under Creative Commons BY-NC-SA license.

Nathan Yergler presented a new search engine prototype that is developed by Creative Commons (article, slidecast). DiscoverEd search engine provides only open educational resources as results. Currently the results come from OER Commons, Connexions, Open Courseware Consortium and several other repositories. The number of indexed content cannot be compared with GLOBE but the results should include only OER’s. I hope that the user experience of this search engine will be in a same level with other Creative Commons tools when it will come out of the prototype phase.

Two interesting projects come also from the Open University UK. Anna De Liddo presented qualitative data analysis tool Cohere (article, presentation). Cohere is a web-based tool and it is specially designed to annotate and analyze web data (blog and forum posts, etc.). In the paper they analyzed one course that took place in P2PU. Cohere had very nice network and cluster visualizations of memos and participants. This work is very interesting for me because we have developed simple course visualizations in EduFeedr. This should be also interesting for my Finnish colleagues who are planning to do a visual knowledge building tool for the next version of FLE.

Another really promising project from OU UK was presented by Simon Buckingham Shum (article, presentation). SocialLearn is a learning community that is designed by the principles of Web 2.0 and social software. Every member has a dashboard with gadgets and a user profile. It is possible to form communities, make connections and follow other people in SocialLearn. The site will be launched later this year.

All together I am really happy that I had a chance to participate the Open Ed conference. There were quite a lot of interesting presentations and probably I missed some good presentations in parallel sessions. Unfortunately there were only five participants from Eastern Europe. If I look at the use of LeMill I think that open educational resources have a big potential in these countries. It would be good if the Open Ed conference would take place in Europe every second year.

Proceedings of the conference are available in UOC repository and can be downloaded also as a complete PDF book.

Posted in Conferences | Comments Off

EduFeedr presentations at Open Ed 2010 and MUPPLE10

I have presented EduFeedr in two conferences recently. The first presentation took place at the MUPPLE10 workshop that was part of the EC-TEL 2010 conference. This presentation and article was focused more on the technical implementation of EduFeedr. The paper “Aggregating Student Blogs with EduFeedr. Lessons Learned from First Tryouts” (PDF) was published in CEUR-WS.

The second presentation was at the Open Ed 2010 conference. This was a more general presentation of EduFeedr and its use on open online courses. I will embed here the slides from this presentation. The paper will be hopefully also online soon.

Both presentations received feedback from the audience, especially the presentation at the Open Ed conference. I will summarize here answers to some of the questions.

To what extent are we going to extend EduFeedr? We have agreed on two limitations that won’t allow EduFeedr to grow into a bloatware LMS. At first only the facilitators have user accounts in EduFeedr. This means that we cannot authenticate the participants after they have enrolled to the course. Still, there will be some activities that they are able to do anonymously. The second limitation is that EduFeedr works without any plugins on the course blog or participant blogs. Most of the learners use hosted blogs that do not allow plugins. This eliminates more advanced assignment workflows. My colleagues are also working on a little bit similar project where they have developed a WordPress plugin LePress for giving and submitting assignments.

Why havent we used PubSubHuubbub or FeedBack? As far as I know, both technologies require plugins on blogs. Therefore we cannot use these because of the decided limitations.

Why do we follow main comments feed instead of separate comment feeds for each blog post that belongs to the course? This is a good question. By following separate feeds we would not aggregate comments that are not related with the course. The downside of this approach is the increasing number of feeds that we have to follow. In a typical course every participant will make 10…15 blog posts. A possible solution is to aggregate comments for older blog posts less often.

How well does EduFeedr scale for large courses? Our current courses have a moderate number of participants (max: 32, total: 152). We have also tested with data from a course with 70 blogs. I would say that current user interface solutions (for example progress diagram) would become a limiting factor sooner than the performance of the system. However, not all people who sign up for massive open online courses are using a blog. For example on PLENK 2010 there are about 1200 participants and 200+ blogs.

Is it possible to install your own instance of EduFeedr? Yes, of course. You can download the source code from the development site. However, the installation procedure is not really straightforward. In addition to EduFeedr you have to set up EduSuckr web service that is actually aggregating the blogs. We would be very happy, if you would use EduFeedr on edufeedr.net. Then we have a better overview of ongoing courses and can identify problems more easily.

EduFeedr could aggregate information about open courses from other EduFeedr instances. This is a great idea! Thanks! However, I’m afraid that it will take time until we get that far.

Why we don’t host EduFeedr development site on some open community such as GitHub? This is a good suggestion. Currently we are using our own Trac and SVN that are connected with user accounts in our department. Therefore it is not easy to involve other interested people to the project. I will discuss this with our developers.

Why are we planning to evaluate the usability with think aloud testing? I do not have a comprehensive experience in think aloud testing but in few cases this method has worked well for us. We give a rather open task for the test users and use Silverback to record the sessions.

We should try to differentiate between the usability and usefulness when doing the evaluation. This is a good comment. I will take it into account.

On the development side it has been quiet in recent weeks. We released a bug fix release two weeks ago and now the developers are busy with another project. I hope to release EduFeedr 0.6 before the Christmas. This release should have a new method for connecting blog posts with the assignments and comments with the authors. Also we are planning to have participant profiles that contain all the blog posts and comments written by the person.

Posted in Conferences, EduFeedr, Presentations | 2 Comments

Presentation in the doctoral seminar

Last week I had a presentation in the Media Lab doctoral seminar. I have been busy with one project deliverable for the last few days and managed to upload the presentation slides (with a few minor edits) just now.

I received quite useful feedback for my work in the seminar. I had a feeling that my plan about combining the articles/projects together as the “open education ecosystem” made sense for most of the people.

Some suggestions:

  • “Designing the Open Education Ecosystem” is too ambitious title. I have designed only some tools to the ecosystem. Also, digital ecosystems have a certain degree of self-organization and cannot be completely designed. Therefore “Desining for the Open Education Ecosystem” would be more suitable title.
  • The 6th article should be written as the introduction chapter of the dissertation. Five articles would be enough for the dissertation. Later the introduction chapter could be also summarized as an article.
  • The main research question “What are the pedagogical, technical and social considerations for designing educational tools for the open education ecosystem?” is too wide. However, finding the balance between the pedagogical, technical and social constraints seems to be the challenge that I have had in each project.
  • I received a good hint that I can use “layers” in my digital ecosystem terminology. Etienne Wenger at al have written a book “Digital Habitats” where they have some ecosystem diagrams with layers. My colleagues in Tallinn have been critical about using layers, because it is not part of the natural ecosystems. I am not sure how far I should go with using the natural ecosystem analogy.
  • I should look at the ‘practice-led research’ method to strengthen the design methodology part.
  • People are missing from my layer images. This is something that must be there when the the three layers are merged into one diagram.
  • Some people were not sure if “social” is the best name for the third layer. At the moment most of the items in that layer are connected to openness. There was a joke to call it the “leftover layer”.

My colleage Teemu Leinonen has proposed a research-based design methodology (only presentation, full article is not available online) where software prototype is seen as hypothesis. In the beginning of the design process the hypothesis is quite fuzzy and it will become more clear during the stages of the design process. For example in LeMill project our hypothesis was that “an online service with learning resources that can be edited and improved by others with tools for social networking and matching of interests among the participating teachers could enhance sharing and collaboration around learning materials“. I have an hypothesis for each case but the main hypothesis can be formulated when my understanding about the open education ecosystem is more clear.

Later we discussed with Teemu about the target audience of my dissertation. I think that the main target will be the open education community. I have learned a lot from the design community but my dissertation will not contribute back so much to the design community. My second target group would be the technology-enhanced learning community, especially now when they are starting to see the importance of design and openness.

Posted in General, Presentations | Comments Off