Posts

Target Use Case Connect to a jupyter notebook server within a remote docker, and open it in your local browser or VS Code. Docker (running notebook) → Host → Mac/PC (Running VS Code/browser) Step 1: Connect from docker to host docker side: expose a port (tell docker you want to use this port),and publish it (actually open up the port and map to the port on the host) Notice that you can only expose a port before running the container # port mapping format HOST:CONTAINER docker run --expose=8888 -p 8888:8888 Jupyter notebook: launch the notebook jupyter notebook --ip 0.

Disk I/O Please see this blog. iostat : it collects disk statistics, waits for the given amount of time, collects them again and displays the difference iotop : it is a top-like utility for displaying real-time disk activity dstat : list all processes that are having effect on system-level changes (like doing I/O).

To get the maximum performance on iPerf, you can optimize several parameters depending on your network and hardware. Here are some recommendations: Use the latest version of iPerf: Ensure you are using the latest version of iPerf (iPerf3 is the most recent major version).

It has been a while since I last wrote blogs for my website, and I do miss it. However, the nature of my work does not allow that. Perhaps I can write more after the next paper submission (while being overly optimistic).

I’ve seen both NFS and Lustre in many clusters. To understand their difference, I decide to dig into it. Both of them can: share a local file system name space across the network; be robust and resilient to network failures.

I gave a talk to SenseTime-NTU lab on distributed machine learning with Data Parallelism. Slides can be accessed here.

Overview One of the poweful features of modern C++ is move semantics. So, what is move semantics? Move semantics makes it possible for compiler to replace expensive copying operations with less expensive moves.

One thing about C++ that attracts me a lot is that it gives me control over the program to a great extent. Therefore, I am starting an article series on why C++ is efficient from the implementation perspective.

The following script was adapted from https://gist.github.com/ryin/3106801, with some improvements and broken link fixes. #!/bin/bash # Script for installing tmux on systems where you don't have root access. # tmux will be installed in $HOME/local/bin.

Recently I came across an interesting topic on memory access optimization named data alignment. I know that struct can be seen as public class, and the performance of struct of array is better than array of struct thanks to contiguous memory.