..

Henry's Feedback of UNSW COMP6714 16s2

The second term of my master degree in UNSW
This blog is sharing my experience of COMP6714: Information Retrieval and Web Search in 2016s2

Useful resources:

Write down your experience about this course through this url (a cse courses’ experience sharing website made by myself):
http://www.unsw.co/rango/category/comp6714
My Final Revision Summary Google doc link:
https://docs.google.com/document/d/1GmrqmyfUs-NWY6NwhVFr8ecPtMjeyUIHsfDh0XD6IOA/edit?usp=sharing
More than 40 students were online at the same time before the day of exam LOL

And thx to everyone contributed to it, didnt expect it at all.

Summary(In the end)

Good things:
1. Well designed labs(Jupyter Notebook) on Github, they are clear and indeed helpful: https://github.com/DBWangGroupUNSW/COMP6714. Looking at the real code makes me understand the concepts and algorithms immediately.
2. Distribution of whole class’s marks is clearly presented.
3. Submitting system. Although a lot of students were complaining about the submitting system(mainly because they didn’t follow the instructions), I think it’s excellent, u have 10!!! chances to improve your highest score. U know in comp9319, u would lose all your mark if u made any small mistake. So the submitting system is relatively kind and generous.
4. The explanation of algorithms in lecture by hand is pretty good and clear.
_
Could be improved:
1. Short comments or feedback on each student’s assignments and the project could be provided.
2. Piazza forum provides a great way of communication, however, a quicker response or better interactive could be provided. For example, questions could be answered in one day to maintain students’ enthusiastic.
3. Things were in a rush. Due to the high teaching & research loads, I always feel that many things were in a rush and have small problems. For example, when the mark released, I didn’t receive an email or get the announcement in the forum. when the solution released, the path is always wrong.
4. The project is too easy, maybe we could be asked to extract all the other relations.
5. Making the lecture clearer and better organized(students complained the most):
I did learn dozens of brilliant ideas and algorithms from this course, however, if someone asks me now without revision: what did u learn from this course? I even do not know how to answer it. It’s because, before and after understanding the algorithm, I always don’t know why I need to learn it and what’s this algorithm is exactly used for, what’s the connection between each part.
I admit that it’s also mainly because of my problem: lacking of preparing and review for each lecture.
Here are my several pieces of advice:

  1. The review slides could be released in the introduction part of the first lecture, it would be a very good guide for students to easily find out what are they exactly learning in different lectures.
  2. The teaching in the lecture harried a little too, the lecturer could be more relaxed and also create more interaction with students. If u asked a very very simple question in lecture but no one can answer it, here is the problem.
  3. For the reason of great gap between students, maybe the total amount of material in lecture could be reduced to make key concepts totally clear first, then providing other sources of information, such as references of harder parts, labs, notes, to students who want to learn more.
    I wrote down all my thoughts straightforward in my mind, ignore some incorrect ideas.

The greatest harvest from this course

I did enjoy a lot and followed well in some lectures, the feeling of learning new brilliant ideas is awesome.
In spite of the knowledge, here are two critical things learned from this course:
1). I’m not afraid of math anyone, in the lecture about BIM, I was totally lost, however in the revision, I finally understood it and found it’s not hard at all.
2). In my bachelor degree, I did some research with a teacher for more than one year, the thing that I regret most is lacking reading papers before writing code. But now, I can read references patiently and solve one problem by myself.

week1 (27/07/2016)

I missed the first lecture because of the late flight :(
Unfortunately, the class was full but the lecturer is so nice and let me enrolled in.
The lab online is well designed and fun, it does help me have a deeper understand of the algorithms in lecture.
I even submitted a pull request to lecturer :)

week2(01/08/2016)

Getting most of the ideas, but totally lost in some math parts, having not learned math for so many years.
Another problem is that Wang looked a bit nervous and cannot make some of the teaching content totally clear, speaking hundreds of “actually” in the 3 hours lecture.

week4 (15/08/2016)

I forced myself to concentrate and followed the lecture quite well.
Maybe another reason is that the lecture is much clearer this week.

week6 Compression (03/09/2016)

Can not wait to learn knowledge from this course!
happiest moment in my horrible 9 hours’ lecture on Monday!

week7&8 Spelling Correction + Information Extraction (12/09/2016)

The lecture was back into a mess. I was lost again…
I heard one classmate judging Wang that he alway jump from one point to another, for example, when he was talking about A, he suddenly remembered B, he would rush to B, then again, jumped to C, finally back to A.
The point is that he should make one thing entirely clear before jumping to another. He is a nice person and great researcher, but he should put more efforts to think about how to be an excellent lecturer.
Of course, another reason is my lacking of preparation, I should spend more time to prepare before the lecture!!!

Assignment1 (20/09/2016)

Ass1(click me to download) is consisted of four questions.
Here is my solution: ass1_solution.pdf
My mark: Comment: 24 | 14 | 25 | 25 | 1
The most awesome part is that, when the mark of ass1 released, lectuer gave the overview(mark distribution) of the whole class:

Project (29/09/2016)

A copy of project spec
Quite interesting, extracting birthday and parents in sentences such as:
Waite, the eldest of five children, was born in White Plains, New York on June 22, 1928, to Ralph H. Waite, a construction engineer, and Esther (nee Mitchell) Waite.
It’s not hard to get a not bad result, but if you pursue the perfect performance, you need a smarter way to deal with the data, such as parsing the sentence to dependency tree and analyze the syntax.
Submitting System
BTW, the submitting system online is awesome!!!
U have ten chances to submit and get your mark, it’s so nice(compared with 9319…).
However, many students complained about this submitting system.. If these stus spent some time to read the spec carefully and simply follow the steps, nothing would go wrong.

The evaluation measure is also brilliant

Project summary (10/10/2016)

As today is the due date of project, I will summarize my thinkings about this project:
I mentioned so many things above that I extremely appreciate, here are things have to be improved in my perspective:

  1. Mistakes in testing and training data:
    Lecturer’s response to this issue:

    However, I still feel the testing and training data has to be more correct. It’s because there were only 400 sentences, rather than 4000, and most of the mistakes in training data are easy for human to distinguish.
    Another critical reason is that these mistakes would make students lose confidence on testing data(highly relevant to their marks..).
    And I kept thinking that one solution is opening a thread in the class forum or GitHub and let students submit all the possible errors, then keep publishing the latest most correct version of training data.
    Unfortunately, it’s not feasible for testing data(can not be seen by students).
  2. Late reply in piazza forum
    I understand that Dr. Wang was extremely busy this semester(as he mentioned many times in lecture.) This forum should be checked at least every day although some of the questions are quite naive and wasting time to answer.
    Mark for Project

    Not bad, but it’s a pity that I only spent one day to get my final result, but then tried everything in the next 3 days without improvement:
    Mark overview:

week11 Evaluation(10/10/2016)

Really enjoy the first two hours, the evaluation part is full of fun and easy.

However, in the last one hour, I was lost in math part again @_@ (Probabilistic and Language Models)
And the lecture ended at 15:01, 6 minutes extended, one critical thing is that this 6 minutes would not be recorded by echo system. It was not a huge issue(However in the revision, this 6 minutes is quite critical and I can not see it..updated in 11/11) and I can see that Dr. Wang did eager to deliver a better teaching, but he also has to pay more attention to these details to improve “user happiness” :)

Assignment2(31/10/2016)

Ass2(click me to download) is consisted of four questions too.
Here is my solution: ass2_solution.pdf
So so so interesting, I have been playing it for the whole day.
The difficulty of the questions was well controlled. I mean all the problems were very hard to me in the beginning, but if I spend some time on it and think harder, all the problems will be solved smoothly.
The pleasure of getting the solution to each question is just unblievable.
** Mark for Assignment2 **
My mark: Comment: 0 | 23 | 25 | 25 | 25
Should get full mark but made a small calculation mistake.

Final Exam(11/11/2016)

The cheat sheet is a good idea because this course mainly examines the way of thinking and understanding instead of remembering.
The actual problem in my perspective is that too much content was included in this final exam. I have no time for all the calculations and even do not have time for thinking.
Another thing I want to share is that actually, there is an 11s2 final exam available online and more than one-third of the content is almost same(of course small and tricky changes were made). And when I published that on my review on google doc(because I feel it’s unfair that a few students do not know it), some Chinese students put comments on the top that, “zuo ren liu yi xian, rang xia yi jie zen me ban and zhuang tm zui diao de”, I was quite shocked and the only reason I can think of is that they already got this previous exam paper and so scared that lecturer knows it and change the final exam questions, the panic of failing the course is so familiar. In contrast, on the day before final exam, I joined a small study group(all the top students in this major excluded me, I’m a total loser of exam) to do the revision together, these people are so brilliant and both hardworking, that’s how a student should be, so admiring. And that’s one of biggest troubles of this course, the unequal capabilities of students, many students just want to pass this course instead of learning knowledge…

** My advice about final exam: **

  1. release one final exam(or exercises) in advance and make changes in the real exam to examine whether students really understand them or not. because I know the solutions to most of the questions in the final exam, but can not solve them without enough exercises before.
  2. reserve the first part but reduce the number of total questions, making more questions such as how and why and designing, instead of endless calculation.

–END–