Tag Archives: Learning

Finding Good Recommendations

There are many online services which attempt to recommend movies, books, webpages etc that someone will like. In some implementations, recommendations are based upon finding new items that are liked by other users: If you like A, and someone else likes A and B, then B is perhaps a good recommendation for you. The difficulty is that establishing your profile can be a tedious task, as you have to initially indicate several items that you like. On the order of twenty items, perhaps.

A new algorithm, developed by Evgeny Frolov and Ivan Oseledets of the Skolkovo Institute, provides a much less time consuming, and likely more accurate, way of establishing your preferences. It uses information about items that you do not like, as well as about items that you like. Roughly stated, if you do not like item B, and those who like B also like C, then item C is perhaps not a good suggestion for you.

The details of their algorithm are subtle, and designed for efficient operation. It is not just graph searching. See Arxiv 1607.04228 for their paper — linked below — and a press release also linked below.

Best wishes,
Ken Roberts
01-Aug-2016


http://arxiv.org/abs/1607.04228

Evgeny Frolov and Ivan Oseledets — Fifty Shades of Ratings: How to Benefit from a Negative Feedback in Top-N Recommendations Tasks


Press Release — Skoltech scientists have created an algorithm that improves the quality of recommender systems

Bernays on Propaganda

Propaganda is the title of a book by Edward Bernays published in 1928. A less provocative title might be Public Relations. Bernays was the pioneer of public relations.

The premise of Bernays’ book is that “in almost every act of our daily lives, whether in the sphere of politics or business, in our social conduct or our ethical thinking, we are dominated by the relatively small number of persons … who understand the mental proceses and social patterns of the masses.” [pp 9-10]. Is that bad? I suppose it depends upon one’s position in society. It is not egalitarian.

Regardless of one’s take on the ethics of propaganda, there is certainly a great deal of realism in Bernays’ view of the world. Anyone who hopes to improve the world should be aware of the ideas and methods described by Bernays.

I wish I had read Bernays’ book many decades ago when I was engaged in social justice and political endeavours. I was no great activist, but did fight many minor skirmishes. Perhaps, using Bernays’ ideas, some situations might have been handled better.

So … a word to the wise — which means you, dear reader! — Bernays’ book is worth one’s attention. It’s a fast read, and decently written. The examples are a bit antique in some ways — 88 years ago — but the book is up to date in essentials.

Best wishes,
Ken Roberts
02-May-2016

Links:

Wikipedia article about the book:
https://en.wikipedia.org/wiki/Propaganda_%28book%29

Wikipedia articla about Edward Berneys:
https://en.wikipedia.org/wiki/Edward_Bernays

Online text of Propaganda, book by Bernays:
http://www.historyisaweapon.com/defcon1/bernprop.html

Scan of first edition of the book, open source:
https://archive.org/details/Propaganda1928ByEdwardL.Bernays

Bernays-Propaganda-cover-png

Climate Change Agreement Text

The purpose of this post is to provide a link to the text of the recent Paris agreement regarding climate change. I’m not sure how this text and its followups are going to be referred to in web links in future, but it appears that search terms (Paris Agreement) and (Framework Convention on Climate Change) are relevant. Perhaps (Paris Agreement on Climate Change). The website http://unfccc.int/ appears to be the online presence of the Framework Convention on Climate Change.

The URL for the text of the agreement itself is at…

Click to access l09.pdf

I have not yet read the text. I post the link at this early date (the text was just adopted yesterday) because the great interest in this topic may lead to an excess of interpretation and commentary, some of which is likely to be grounded in emotion rather than consider the substance. I will read the text.

My own interest in Climate Change is more towards the physical data. To that end, I am enrolled in an intro geography department course (2nd year undergrad level) on climate change, as an auditor. That course is oriented towards a study of the physical data. There are many significant social and political aspects, and I do not mean to trivialize them. In my personal life, I have found political work is much like washing dishes — necessary, and needs to be re-done every day after the dishes have been used as intended. Washing dishes can be calming and contributes to good health of oneself and others. It is an appropriate use of a part of one’s time, even if not one’s core role in society.

Likely my subsequent posts on the topic of climate change will be regarding physical data, as interesting tidbits of information come by.

Best wishes,
Ken Roberts
13-Dec-2015

Wigner and Dirac

I’ve been reading a brief sketch of Eugene Wigner’s life, written by Jagdish Mehra, in vol 1 of Wigner’s collected papers. Well written, and enjoyable. Great scientists come from various origins with various career intents. Wigner’s original plan was to be a chemical engineer. He took courses in physics and inorganic chemistry, and worked on the crystal structure of rhombic sulphur. His doctorate was in chemical engineering. All this study up to about 1925. By 1928, three joint papers with his friend John von Neumann, and in 1931, Wigner’s book on group theory and atomic spectra.

These years were a time of great intellectual ferment. Recently I ran across the 1928 volume of Zeitschrift for Physik which begins with four papers on the (new) Fermi-statistics (nowadays Fermi-Dirac statistics) version of the gas theory of electrons in metals, two papers by Arnold Sommerfeld and two by colleagues working with him. These years were also a time of great political turmoil; it is interesting how much scientific work was done in those times, despite the political disruptions. “Carry On and Keep Thinking”.

One other bit … Dirac married Wigner’s younger sister, Margit, in 1934. Many of the other marriages noted in Mehra’s biographical sketch of Wigner were between people with physics connections. It was a close-knit community of people with shared interests and outlooks upon the world.

My university library has only volume 1 of Wigner’s collected works (which seems to run to 5 volumes of scientific plus general articles), but even this single volume has much useful scientific information.

Best wishes,
Ken Roberts
14-Jun-2014

Motion Mountain

A new edition of Motion Mountain – The Adventure of Physics, the e-book by Christoph Schiller, is available for downloading. I first encountered this book about four years ago, and tremendously enjoyed browsing in it — until the pressure of coursework drew me away. This new edition has reminded me, and I’m enjoying it as much as before. Perhaps more, as I now bring a bit of background with physics concepts to the reading. The subtleties of Schiller’s discussion of can motion exist, is motion just a matter of perception, are enhanced by the close encounter I had four years ago with a philosophy of space-time course.

It is possible to get a good physics education online. The facts are all available. The only things missing are a framework for discussion with others (though the physics stack exchange and other websites can help) and access to the prior literature (though arxiv.org and archive.org and other websites help there also). Schiller’s open writing style, roughly described as speaking with one rather than at one, provides some of the feeling of having a discussion. And his e-book has numerous active links to throught-provoking resources.

Motion Mountain is free. The pdf files (one per volume, 6 volumes in all) can be downloaded directly from Schiller’s site, which is at the URL http://www.motionmountain.net/ This is a truly wonderful learning resource.

Best wishes,
Ken Roberts
10-Jun-2014

Photocopier Memories

Today, while operating the photocopier, I realized that my activities have come full circle. My first job was operating a photocopier. At that time (about 1965) photocopiers (Xerox machines, we called them) were very expensive, and the Faculty of Social Science at Univ of Chicago had only one machine. A student was assigned to operate the photocopier, in order to keep the work flowing through at maximum speed. There was an endless stream of requests to make copies — articles from bound journals, and other documents.

The copier was rather slow, so there was time to try to read the prior page while the current page was being scanned. Of course half the time the prior page had come out in the feed tray “upside down”, because the journal would be flipped around for half the pages. I could not read very fast in that orientation. Thus my brief and fragmentary introduction to many topics of social science.

Did I meet some famous people there? Yes, a few. I also was the Saturday morning mail clerk, keeping the mail room open so faculty members could come in and pick up their mail. Some people were open and friendly, and others rather aloof. Saul Bellow had been awarded some prize (Nobel for literature, perhaps) about that time, and I had read his recent novel “Herzog”. I mentioned that I had read it, and there was an error. His protagonist had exited the freeway onto a particular street in Chicago, but there was actually no freeway exit at that street. He grunted at me. Likely thinking “Oh, preserve me from literal minded science students!”.

Best wishes,
Ken Roberts
27-May-2014

Brian Johnston Flower Macro-Micro Photography

One of the many excellent web resources is A Flower Garden of Macroscopic Delights, by photographer Brian Johnston. The URL for the index page is http://www.microscopy-uk.org.uk/mag/bj-flowers.html

I have had the pleasure of a detailed review of two of his articles — about white oak, and about single-seed hawthorn — in conjunction with a biology unit I am working through with a home study student. They are excellent. Johnston starts with a photo of the tree or plant, then moves in to examine various aspects of it in detail, using both macro and micro-photography. His explanations are very clear, and when Johnston notices something curious, he tells the reader.

There is a project opportunity in connection with the hawthorn sequence. Not sure if it would be graduate school or science fair — the two levels of investigation are not that far apart, after all. Spring is coming, and if you have access to hawthorn trees, you will want to examine specimens of their flowers. See Johnston’s article for details.

Wherever one looks in nature or science, there is plenty of opportunity for interesting projects. So little has been explored ! So much is beckoning !

Best wishes,
Ken Roberts
10-Mar-2014

Curly Hair and Straight Hair

Yesterday I was sitting with a young man who is interested in forensic work, and we were looking through an atlas of microphotographs — of human hair, animal hair, fabrics, and so on. Fascinating! It’s always a pleasure to look at a lot of examples of some category of object. Induction is a great way to discover relationships.

In this particular case, we realized why black people have curly hair. Among its many photos, the atlas has cross-sections of head hair samples from three racial groups. The Negroid hair sample cross-section is oval, with a length:width ratio of about 13 to 6; such hairs will curl very readily. The Caucasoid hair sample cross-section is also oval, but with a length:width ratio of 13 to 9; such hair will curl, but less readily. The Mongoloid hair sample is almost round, with a length:width ratio of 13 to 12; such hair will not have nearly as much tendency to curl. I don’t know whether the dimensions of these hair samples are typical, but the length:width ratio is at least a preliminary hypothesis for the structural basis for hair to be naturally curly or straight.

The book is “Color Atlas and Manual of Microscopy for Criminalists, Chemists, and Conservators”, by Nicholas Petraco and Thomas Kubic, CRC Press, 2004, and the hair sample microphotos are on page 220. If you have a change to browse through this or a similar book (this copy came via an academic library), I’m sure you will find it interesting.

Best wishes,
Ken Roberts
03-Mar-2014

Opening a Seed Bag

Seed bags are stitched so that they can easily be opened if one pulls the string in the correct manner. But if one does not use the right technique, instead of a quick and easy task, one has a frustrating time opening the bag, which usually requires cutting the thread in multiple places. I asked an expert, the guy who stitches up the bags, and got his advice, and share it with you here.

To start, find the correct end of the bag. This is the 1-2 method and think of it like counting, 1 on the left and 2 on the right. Position the bag so it has 1-string stitching on the left side, and 2-string stitching on the right. You are at the end of the bag.

Now snip (or untie!) the thread near the bag. If necessary, pull the cut end of the string through the bag, so that the cut end is on your left, the 1-string side of the stitching. Then pull the cut end of the string gently, and the string will unzip from the bag. Voila!

Here are some photos … first, the left side of the bag (1-string side):
seed-bag-1-thread

And the right side of the bag (2-string side):
seed-bag-2-thread

And the bag as it is unzipping. You are looking at the right side, at the loops of stitching. You can just make out the end of one loop as it is being pulled through the other:
seed-bag-opening

Happy opening, and best wishes,
Ken Roberts
20-Feb-2014

A Crank Learns Physics

Recently a new blog was started, A Crank Learns Physics, which represents a serious self-study program for learning physics. I wish him well. The first substantive post, on Geometric Algegra, has already appeared. The books being used as references are Doran and Lasenby — Geometric Algegra for Physicists (2003), and Susskind and Hrabovsky — The Theoretical Minimum (2012). With possibly an ultimate goal of being able to follow Landau and Lifshitz’s 10-volume Course of Theoretical Physics. Understanding the subtleties of L+L is my personal goal, and although I’m not familiar with the D+L or S+H books, I’ll be happy to give those books a look, in order to follow along with the posts of the “Crank”. I like his name particularly because he has a background in film-making — crank is a nice pun.

Here is a link to the new blog: http://acranklearnsphysics.wordpress.com/

Welcome and best wishes to another physics enthusiast!

Ken Roberts
09-Feb-2014

Mistakes — How to Learn from Them

Making mistakes is one of the best ways to learn. Yet, we are taught to believe that making mistakes is wrong, and students are penalized for mistakes. That is unfortunate, and in this post I wish to argue for the merits of making mistakes.

Watch a baby learn — moving about, grasping, throwing, speaking, and so forth. A parent would be justified in serious concern if their child did not make constant, though unsuccessful, attempts to move about, grasp, throw, or speak. The child learns to succeed through repeated attempts, most of which are unsuccessful. Thousands of attempts to move about, to grasp, to throw, or to speak strengthen the neural and motor structures which allow for later success.

Youth is the period of our lives when we learn the fastest. I think that is partly related to it being the time when we attempt the most, that is, make lots of mistakes. Perfection and predictability are in opposition to the ability to learn.

I heard a story of an engineer in a research institute, who, when he had an idea, would try it out on his colleagues, one by one. He would walk into someone’s office, set forth the idea, and it would be shot down, full of flaws. He would revise his idea, and go to the next colleague — same result. After he had visited many colleagues, his idea would have become refined by the various circumstances and considerations set forth by his colleagues. If his idea survived, it would be robust. Most ideas would not survive unscathed; in fact, most might not survive the chain of validations at all. But the good ideas — the few percent that were really worth pursuing — would become much better. That engineer must have been known to his colleagues as a person who made lots of mistakes. It takes guts, or humility, to appear “silly” in order to keep learning new material, since that invariably involves mistakes.

I was trained as a mathematician, a field which, more than most others, puts a high premium on error-free problem solving, the avoidance of mistakes. When I became a computer programmer, it took a while for me to discover that the most effective way to program is to develop partial solutions, and then refine them (debug them) against realistic requirements. Effective programming involves the art of making mistakes, repeatedly, and learning from and extending the software based upon the experience of those mistakes.

Having returned to the academic world, in retirement, as a student, I notice that academic life puts a high value on being relatively mistake-free. That is a trap, a social pressure that can lead to reduced productivity. Mistakes, lots and lots of mistakes, whether in academic or industrial settings, are important in order to make progress.

Here’s hoping that you are able to enjoy making mistakes, as much as I do!

Ken Roberts
28-Jan-2014