[fvplayer id=”1″]
Just a short little video milestone of Elliott finding her voice, which sounds raspier than usual since I think she may have overdone it yesterday, making this “ah ah ah” noise for 14 hours.
Author: mattchung
-
Advanced Operating System Notes (File Systems)
Although I’ve covered file systems in previous courses, including graduate introduction of operating systems, I really enjoy learning more about this concept in a little depth. The file system’s module is packed with great material, the material introducing a high level introduction of file system and then jumps into the deep end unveils what an operating system does behind the scenes.
Main Take Aways
- The high level purpose of a file system provides three key abstractions: file, filename and directory tree.
- A developer can interface with the file system in two ways: a position based (i.e. cursor) and a memory based (i.e. block)
- C function strol converts a string to a long
- Mmap system calls maps a file on the file system to a contiguous block of memory (the second method a developer can interface with a file systeme)
- FAT (file allocation table) glues and chains disk blocks together. It is essentially a linked list (persisted as a busy bit vector table) that is great for sequential reads (i.e. traversing the linked list) but awful for random access (i.e. to get to the middle, need to traverse from head)
- EXT linux file system is based on inodes and improves random access using 12 direct pointers (13th pointer provides first level of indirection, 14th pointer second level of indirection, 15th pointer third level of direction)
- Learned about the buffer cache (i.e. write-through) and how we a journal can help stabilize the system while maintaining decent performance
Linked list and busy bit table -
My First Research Paper: COVID19 and the impact on higher education
Abstract—This research paper explores the impact of the COVID-19 health crisis on the education sector by unpacking the challenges and successes of the forced migration of professors and their curricula onto online learning platforms. Quantitative research was conducted in the form of a domestically focused survey to determine the success of those teaching models and the transition to online education by focusing on the experience of educators. This paper ultimately argues that under the specter of a pandemic, the ensuing online education has been as successful as possible, and that despite a myriad of global negative impacts, COVID-19 has opened the door to reform traditional learning, allowing educators to take advantage of this golden opportunity to unlock the power of online education.
Above is the abstract pulled from my first ever research paper: What does effective education look like in the context of COVID-19, and how can subsequent successes and challenges be measured in order to ensure the future of online learning and the educa- tors that make it possible?
I conducted the research (read at least three dozen of other educational peer reviewed papers, designing my own survey, sending survey out to thousands of professors teaching domestically) over this past summer as part of Georgia Tech’s Educational Technology Course. Essentially, I wanted to identify the “best practices” of teaching in the midst of COVID19 and compare them against what was really happening: chaos.
For the survey, I was able to collect responses from 500+ professors teaching at universities including Massachusetts Institute of Technology, Georgia Tech University, University of Washington and much more1.
Surveyed professors teaching at schools including Massachusetts Institute of Technology (MIT), Georgia Tech University, University of California Berkeley -
Daily Review – 2020/08/20
This post reviews yesterday, Wednesday August 19th 2020. Should I change the title to yesterday’s date or keep today’s date? Not sure, but I should probably stay consistent in my posts moving forward.
Although I’m physically exhausted and tired than usual from waking up early (around 04:30 to 05:00) every day to crank out studying or homework assignments, I feel emotionally and mentally better, less stressed out, knowing that I’m making forward progress on my assignments instead of dealing with an avalanche of work over the weekend.
Photo of the day
Breakfast on the hotel floor (Suncadia Hotel) with Elliott and Jess Word of the Day
Despondent – in low spirits from loss of hope or courage.
-
Advanced Operating Systems – Day 3 Recap
The below write up consists of notes that I took while watching Multi-Threaded programming module from the Advanced Operating system’s refresher course1. I watched this third module before the second module (on File Systems, the next lecture series I’ll watch) because I started tackling the homework assignment that has us students debug a buggy multi-threaded program written with the POSIX threading library.
Although I was able to fix many of the problems by writing the man pages of various system calls (e.g. pthread_join2, pthread_exit3), I wanted to back my troubleshooting skills with some theoretical knowledge, and I’m glad I did because I had forgotten that if the main thread (first thread that spawns when OS starts the process) calls exit or return, then all threads exit; this behavior can be modified by having the main thread call pthread_join instead, causing the main thread to wait for some other specific thread to terminate.
Recap
Shows that Thread shares the heap, globals, constants, and code – but contains its own stack Writing multi-threaded code is difficult and requires attention to detail. Nonetheless, multi-threaded offers parallelizing work — even on a single core. Threads are cheaper in terms of context switching when compare to process context switches, since threads share the same memory space (although each thread manages its own stack, which must be cleaned up after if the thread is created as a joinable thread — detached threads, on the other hand, are cleaned up automatically when they exit) When using threads, there are a couple different design patterns: team, dispatched, pipeline. Selecting the correct design depends on the application requirements. Finally, when writing multi-threaded programming, the program must keep in mind that there are two different problems that they need to consider: mutual exclusion and synchronization. Regardless, for the program to be semantically correct, the program must exhibit: concurrency, lack of deadlocks and mutual exclusion of shared resources/memory.
-
Advanced Operating System Notes – Memory Systems (2/2)
Notes below are from my first study session at 05:00 AM, before I hit the rest of my morning routine: walking the dogs at the local park, blending a delicious fruit smoothy (see my blog post on best vegan smoothie), then jumping behind the desk for hours for work. In the evening, I detoured from watching lectures and instead, focused on working on the pre-lab assignment (write up on this in another post)
Page table – the underlying data structure that maps virtual pages to physical pages Summary
Rest of the video lectures wraps up the memory system, discussing how virtual memory and its indirection technique offers a larger address space, protection between processes and sharing between process. For this to work, we need a page table, a data structure mapping virtual page numbers to physical frame numbers. Within this table are page table entries, each entry containing metadata that tracks things such as whether the memory is valid or readable or executable and so on. Finally, we can speed up the entire memory look up process by using a virtually indexed, physically tagged cache, allowing us check the TLB and Cache in parallel.
-
Daily Review – 2020/08/18
- Seems like my mind and body know to wake me early in the morning (around 05:00 AM), a small window in time in which I can cram in a lot of work before everyone else wakes up
- Thinking about daily reviews rolling up into weekly reviews, into monthly reviews, etc
- Out of the corner of my eyes, I witnessed a spider dashing across the room, so I caught it and temporarily placed it under a glass jar, the spider now sitting table and birthday card (will free it later)
- Jess and Elliott accompanied me this morning, the two of them joining me on my daily dog walk (a couple photos below)
- Caught Metric red handed: she was about eat her poop, so I slapped the kitchen window, freaking her out, at which point she ran inside the house
- Watched half an episode of The Community — I love Abed — while eating dinner with Jess
- Elliott woke up non stop during dinner, not giving Jess a single moment to relax or really even finish dinner in peace (one day this will change, they say)
- At work, focused on reviewing team member’s code reviews, deploying some of my new features (to us-east-1)
- Squeezed in two major study sessions, one at 05:30 AM until work (with dog walk in between) and one in the evening (this session focused on me stepping through multi-threaded code using the graphical debugger, me switching threads and inspecting the instructions and stack)
Tired puppy from chasing the ball -
Advanced OS – Study Notes Reflection (from day 1)
I divided studying into two sessions: one in the morning (around 04:30 am) and one in the evening after work and after my daughter has gone to bed. In the morning, I completed the administrative tasks and watched lectures that cover new material and in the evening I refreshed my memory by taking the operating systems review course.
OS Fundamentals Review: Quiz on calculating tag, index, and offset for cache entries -
How to configure Ubuntu w/ nested virtualization using Vagrant and Virtualbox on MacOS
If you are taking advanced operating systems course at Georgia Tech (OMSCS) and want to run the the lab environment on your mac laptop (or desktop) using Virtualbox, then follow the below instructions. Below, you’ll find a Vagrantfile that will launch a virtual machine, install Ubuntu and configure nested virtualization:
Virtual box w/ nested virtualization