Young Hands Club

August 26, 2019

Week 7 tasks

Filed under: Shreyas Ragavan — Shreyas Ragavan @ 5:24 a.m.

Priority 1 : Tasks 1, 2
Priority 2 : Tasks 3, 4, 5
Priority 3 : Tasks 6

  1. [ ] v.py : 10 lines, minimum.
  2. [ ] Continue reading the book Serious Cryptography
    1. The primary goal is to cover the necessary portions to move forward with v.py, and atleast an overview of encryption as a concept, and the process of hashing, which will help me understand signatures.
  3. [ ] Learning about software and the software industry (Spillover from week 6)
    1. [ ] Summarise / Discuss: http://ossasepia.com/2017/02/18/the-open-sores-of-monkey-code/
    2. [ ] Summarise / Discuss http://ossasepia.com/2017/06/12/o-brave-new-code/
    3. [ ] Read: http://ossasepia.com/2017/12/21/eucrypt-correcting-mpi-implementation/
    4. [ ] Summarise / Discuss: http://trilema.com/2019/no-platforms/
  4. [ ] Complete partially finished pending Python basics revision.
  5. [ ] Open Data : Wages dataset
  6. [ ] Learn + Summarise :- systemd | init ( Refer log)

Week 6 Review

Filed under: Shreyas Ragavan — Shreyas Ragavan @ 5:23 a.m.

Notes:

  • Due to a sudden demand from the mines, I was unable to devote significant time and energy to the planned tasks. As explained in the channel: this should ease off in another week or at the most two - I am working specifically towards making that happen. Meanwhile - I will work on higher priority tasks.
  • I've actually completed more than I thought I would manage, though I was stuck for a while with v.py before suddenly seeing some light in some areas.
  • I've improved in rejecting shiny distractions and pacing myself. I've found the latter is also a reason I missed earlier review deadlines, because I floundered around 'working' till I had no energy left to review, and did not want to review till I had finished the task. Such an approach is fueled by feelings rather than thought, and does not produce the intended result. I also have to improve in my estimation of the time it takes to review.
  • Based on the discussion today, I've decided to make an effort in savoring progress and not become overly dejected when I cannot attain a goal. i.e to strive for a more balanced way of thinking and to give progress the time it needs.

Review:

  1. [ ] v.py : 10 lines, minimum.
    1. I have made (minor) progress with the vdiff algorithm. It appeared that I need to understand atleast the terminology and fundamental concepts of encryption better to understand what V does, and why. For example, I am now familiar sending encrypted messages and the basic idea of a GPG key pair, but I had not explored the terminologies of symmetric, asymmetric and the process of hashing. I have just started reading the book Serious Cryptography which I found after today's discussion on #ossasepia. There appears to be a significant gain in comfort through reading the structured text even though I've barely finished a single chapter.
    2. Refer Updated prelim notes.
    3. Some questions still remain as shown in the post - but I would like to make one more attempt at cracking it, and think I should be able to, though I will not wait long before asking for help.
  2. [ ] Complete partially finished pending Python basics revision.
    1. Dropped this task due to the redirect in focus.
  3. [X] GLMnet results issue - spillover from Week 5.
    1. This was resolved. Luckily, it was almost resolved even before the redirection of focus. Additionally, as hoped - I was able to make more inroads into grokking Linear Regression and in particular Penalty based extensions like glmnet. Re-reading things I read in the past was invaluable in making these new connections. I know enough now to apply the glmnet algorithm as well, but I strongly think - I need a little more depth, and definitely a revision.
    2. I started writing a summary of the problem, but realised that I also wanted to interweave a summary of the algorithm itself, and did not have enough clarity to do so. This was paused to work on v.py.
  4. [X] Hash out project plan for exploring Open Data, and using it as practice. Datasets of 'interest'
    1. Computer price index
      1. Decided to start with the wages dataset as it appeared more interesting at this point, based on a brief exploration of the datasets.
    2. [X] Wages
      1. Generic plan is laid out. A brief exploration of the dataset is complete. It appears to be a good dataset to work with, i.e there are challenges in the data wrangling and exploration. Refer Blog post.
  5. [ ] Learning about software and the software industry
    1. None of these subtasks were completed.
  6. [X] Improve summary of 'Your feelings are to get you', based on Diana's comment. (1 paragraph).
    1. This was completed, but I am yet to respond to Diana's subsequent comment about the improved summary appearing like a first pass. Though I did draft a response - I was not satisfied with it, and wanted to give it more attention.
  7. [ ] Learn + Summarise :- systemd | init ( Refer log)
    1. [2019-08-20 Tue] This task is at the lowest priority as advised in earlier comments.
  8. [X] Formulate response to Diana's comment on 'what is data science'. Worth noting that this was discussed before. My 'view' has improved, since then, but I'm not sure I would answer very differently.
    1. This was discussed in the comments on the previous post. My definition has in fact changed slightly since the same, which is expected as I progress in my learning. However, I will keep note of Diana's advice and focus on specific projects, rather than an ambiguous and rather unhelpful goal of 'conquering data science'.

August 19, 2019

Week 6 Plan

Filed under: Shreyas Ragavan — Shreyas Ragavan @ 3:55 p.m.
  1. [ ] v.py : 10 lines, minimum.
    1. My intention is do more than 10 lines, but I will set 'smaller' targets untill I gain confidence.
  2. [ ] Complete partially finished Python basics revision.
  3. [ ] GLMnet results issue - spillover from Week 5.
  4. [ ] Hash out project plan for exploring Open Data, and using it as practice. Datasets of 'interest'
    1. Computer price index
      1. Computer price index - by type of purchaser, monthly link
    2. Wages
      1. Wages, salaries, employers social contributions. by province and territory link
      2. Employee wages by occupation, annual link
      3. Employee wages by industry, annual link
      4. Wages - 2017, 2018 link
  5. [ ] Learning about software and the software industry
    1. [ ] Summarise / Discuss: http://ossasepia.com/2017/02/18/the-open-sores-of-monkey-code/
    2. [ ] Summarise / Discuss http://ossasepia.com/2017/06/12/o-brave-new-code/
    3. [ ] Read: http://ossasepia.com/2017/12/21/eucrypt-correcting-mpi-implementation/
      1. [ ] Understanding this article will need me to first complete http://www.dianacoman.com/2017/12/07/introducing-eucrypt/, which has been suggested earlier. I did start reading the same, but wonder if it would be better to attack this after gaining some traction with V.
    4. Summarise / Discuss: http://trilema.com/2019/no-platforms/
  6. [ ] Improve summary of 'Your feelings are to get you', based on Diana's comment. (1 paragraph).
  7. [ ] Learn + Summarise :- systemd | init ( Refer log)
    1. Guidance on articles to definitely read would be helpful.
  8. [ ] Formulate response to Diana's comment on 'what is data science'. Worth noting that this was discussed before. My 'view' has improved, since then, but I'm not sure I would answer very differently.

Week 5 Review

Filed under: Shreyas Ragavan — Shreyas Ragavan @ 5:06 a.m.

Tasks from the earlier week with notes / results.

  1. [ ] v.py : Minimum 10 lines this week, gain familiarity with the concept and document notes. Some progress has already been made propelled asciilifeform's comment regarding v.py being the non-docker solution to reproducible environment. Notes so far will be published today.
    1. Produced prelim notes. As such it is a win, compared to avoiding it, but I could not go beyond this.
  2. [X] Complete draft response to Diana's comment on the 'indiewebifying my website' post and publish.
    1. See blog post.
  3. [ ] GLMnet: Linear Regression algorithm is showing different (and some strange) results on different computers. This has to be replicated and investigated. Additional revision of past learning on Linear regression to be done, and preferably published.
    1. I did revise my earlier studies in Linear Regression, but could not attack the problem. The task will be addressed next week.
  4. [X] Summarise the article feelings are out to get you
    1. See blog post.
  5. [X] Formulate a checklist based on CH article, and add related tasks next week.
    1. See blog post. Some tasks have already been completed.
  6. [X] Re-evaluate and Re-prioritise tasks/projects from past 'plan' to 'conquer' datascience such that more time/energy/focus is given to tasks from Diana and TMSR.
    1. This should reflect in the upcoming weeks, through the plan and the results. There are several pending projects that I can pick from.
  7. [X] Summarise progress this week and plan next and post this on [2019-08-18 Sun] or before.
  8. [X] Maintain consistent communication on #ossasepia and get into the habit of publishing draft notes, even if 'incomplete' or transient, with a 'Q&A' section, so that Diana can review.
    1. Improvement has been made in this regard. It has to be maintained consistently.

1 "Other things"

  • Meandered into updating my website. Followed the outline in Trilema post and covered most of it. In the process, learnt some PHP and gained some knowledge about WP under the good. I was able to port features from one theme to another, and create a new page template.
    • Enabled syntax highlighting for Emacs lisp in the current WP theme by assigning it to the same syntax highlighting (+ recognition) as clojure. This is a good win, because almost all the Emacs posts looked terrible.
    • [ ] A side project is to put these changes into a fork and initiate a PR to the main theme. I am certain to find other ways to enhance the theme in time. The developer has stated he would welcome this on IRC.
  • Ported almost all the notes/posts published on my earlier website into WP, and figured out the correct method to upload inline images from org2blog. This was a relief, because past articles could be easily uploaded, images and all. Most of the detailed notes can be found under the Technical notes category, and this includes the notes made on Docker last week.
    • Posted an issue / reached out to the developer regarding specifying taxonomy and other aspects while exporting from org2blog.
    • Improved the categorisation and tags on website, though there is still a large number of uncategorised articles.

2 Areas of improvement

  • wasted time with the web futzing. From my side - I am now satisfied with the results and will only look at aesethetic improvements as low priority projects. Though it was exciting to be able to modify the themes settings and get results - it was not important at this point.
  • I have reached the point of review in time, (which is better than last week) and some tasks have spilled over. However, I expect to catch up this week and do better. It was also satisfying to implement the guideline in the Trilema article. I guess I am starting to use the WoT.

August 16, 2019

Tasks for Week 5

Filed under: Shreyas Ragavan — Shreyas Ragavan @ 11:58 p.m.

These are my target tasks to be completed this week.

  1. [ ] v.py : Minimum 10 lines this week, gain familiarity with the concept and document notes. Some progress has already been made propelled asciilifeform's comment regarding v.py being the non-docker solution to a reproducible environment. Notes so far will be published today.
  2. [ ] Complete draft response to Diana's comment on the 'indiewebifying my website' post and publish.
  3. [ ] GLMnet: Linear Regression algorithm is showing different (and some strange) results on different computers. This has to be replicated and investigated. Additional revision of past learning on Linear regression to be done, and preferably published.
  4. [ ] Summarise: http://thewhet.net/2013/09/your-feelings-are-out-to-get-you/
  5. [ ] Formulate a checklist based on http://cascadianhacker.com/how-to-actually-learn-programming, and add related tasks next week.
  6. [ ] Re-evaluate and Re-prioritise tasks/projects from past 'plan' to 'conquer' datascience such that more time/energy/focus is given to tasks from Diana and TMSR.
  7. [ ] Summarise progress this week and plan next and post this on [2019-08-18 Sun] or before.
  8. [ ] Maintain consistent communication on #ossasepia and get into the habit of publishing draft notes, even if 'incomplete' or transient, with a 'Q&A' section, so that Diana can review.

August 14, 2019

Review + Summaries - Week 3 and 4

Filed under: Shreyas Ragavan — Shreyas Ragavan @ 2:22 a.m.

1 Review:

I've slipped backwards in my weekly summaries on http://younghands.club. I've actually been apprehensive about looking at v.py, and that it is beyond my capability. I wanted to finish the work and then speak up on ossasepia, and do realise that it is better to communicate, Diana has advised earlier.. perhaps more than once. Sometimes, I am just unable to say anything meaningful, or things are in such a state of flux in my head. This review and summary is an attempt to analyse the same.


Though I did revamp my workflow after a discussion with Diana, and that definitely helped me think better - I am still plagued by wanting to do something that could be indirectly related.

I typically take the effort to plan, break down things into tasks and even schedule them. I have all the tools and workflows at my disposal to do these things.

My first step in any project, is usually a project outline and notes, which become tasks as I move along. It seems like I want to rebel against the plan and still succeed. I'm constantly looking for a thrill, and to work with inspiration. Sometimes the inspiration is elsewhere, and on occasion I do not know if it is really inspiration. If not, perhaps it is that I manage time a lot less well than I think I do. To counter that, I can say that I have done more in the last 4 weeks than in a while. It is still important to remind myself that there is plenty of room to improve.

So, I often 'stumble' upon an obsessive urge to 'complete something first', with the idea that 'a lot of other processes will be streamlined if I finish this first'. While the ideas are in general worthy and not incorrect or useless - they are usually not 'easy' like a quick fix.

In short, these excursions cannot be planned as 'short distractions', which I have tried. The chunks of time I put in seem to cover several days. My note taking has been sketchy in some areas. I am yet to complete publishing my brain dump. As I think backwards - I think I have added to these and more - almost every other day. A portion of the notes are on https://shrysr.github.io/docs/.

Beyond these notes are numerous projects which are stored as individual, private git repositories (Bitbucket). Some done almost to the end, and many barely started. Very less original work. For example, tidy Tuesday was one of the challenges I took up, which lasted only a week. I actually have a few more tidy tuesday projects outlined. There is for example,

2 Week 3

  • [ ] The planned deeper exploration of the UMAP algorithm is pending. I think that to be able to test the UMAP algorithm on different , its is important to be able create reproducible environments for them. This has to be done using Docker.
  • Made significant headway in the Dive into Docker course. The notes are being consolidated and will be posted (as a blog post) which will be updated as I add to it.
  • Wrote about needing to resize the swap partition in Linode to install the UMAP library. This was quite easy to do, considering the relatively painful experiences in the past. The first Linode I set up had a generous swap allocation from the start, and I forgot to do so in the 2nd (current) instance.
  • Started documenting the effort to build a datascience docker container to aid in the exploration of UMAP and any such related projects.
  • Gained comfort in deploying docker containers locally, as well as on the VPS.
  • Connected the Business Science Slack channel to weechat. So I am running Slack in the terminal and it has actually been wonderful. I need to gain a lot more comfort in using weechat to reduce some pain points. I've actually started posting messages in it, composed on Emacs.
  • Customised tmux better and learnt more about weechat. There was an increased interaction on the IRC channels of Linux, weechat, weechat-slack, as well as Emacs. For example : I got to interact with Technomancy on the Emacs channel, mentioned here. My notes regarding tmux and weechat have been rather sparse. These are the commands that I am most unfamiliar with.

3 Week 4

  • Successfully 'indiewebified' my site. I believe this is a step in the right direction. i.e making the website accessible to microblogging, and a customisable categorisation of posts and conversations, as my updated post archive will indicate. Anybody visiting the website, will get a better view of what I do, and I can post across networks. Unfortunately, this does not cover Linked in, but in general - my interactions can be viewed via the 'Browse' widget on the Side bar.
  • Composed a little bookmarklet to reply to any post / website with a click. Several other bookmarklets are also used as mentioned in the article, making it easy to like or comment / ping an article and directly feed that to my website.
  • Okay, as of now - it does stand on a bunch of chairs like indieauth, brid.gy and several WP plugins. It is not self contained like I had planned. However, it is also clear that the entire workflow can be replicated with some effort on a local server, and thus there is potential to ensure stability. See link for the list of libraries.
  • More customisation will be needed - both with the org2blog package as well as the indieweb WP plugins. I can first define and then plan these side projects as I find time. Support can be found in the IRC channels.
  • Received compliments from a fellow student in the Business Science university slack channel about having been helpful via answering queries. In the future, I intend to post my replies and summarise those as well on the website.

4 Plan

  • [ ] This will be updated tomorrow. Sleep.

Powered by WordPress