useful scripts

Useful scripts for making developer's everyday life easier and happier, involving java, shell etc.

Daily useful manual operations are made into scripts for easy use, making the daily life of development easier. ?

welcome? ?

• Ask a question, submit an issue
• Share functions (i.e. requirements, ideas) that you usually use but have not written into scripts, and submit an Issue
• Optimization and improvement, Fork and post-contribution code through Pull Request
• The provided script is easy to implement, and the Fork post-processing is provided through Pull Request.

The scripts in this warehouse (such as Java related scripts) are deployed and used in the online production environments of companies such as Alibaba (such as Pioneer Cloud, see awesome-scripts warehouse description).

If your company has deployed it, you are welcome to collect and notify users through Issue: who's using | user feedback, so as to facilitate mutual exchange of feedback ~ ?

---

• ? Quick to download & use
• Use documentation
  • ☕ Java related scripts
  • ? Shell related scripts
• ?Developer Guide
  • Goals for developers
    • About Shell scripts
  • ? Development Agreement
  • Shell learning and development information

---

? Quick to download & use

 source <( curl -fsSL https://raw.githubusercontent.com/oldratlee/useful-scripts/release-3.x/test/self-installer.sh )

For more downloading and usage methods, see Download and Usage.

Use documentation

☕ Java related scripts

1. show-busy-java-threads
   Used to quickly troubleshoot Java CPU performance problems ( top us value is too high), automatically find out the threads that consume the most CPU in the running Java process, and print out their thread stacks to determine the method calls that cause performance problems.
2. show-duplicate-java-classes
   Find duplicate classes in jar files and class directories. Used to troubleshoot Java class conflicts.
3. find-in-jars
   Search for class or resource files in all jar files in the directory.

? Shell related scripts

Shell usage enhancement:

1. c
   Output the command line as it is and copy the standard output to the system clipboard, eliminating the need for CTRL+C operations and optimizing the operation flow between the command line and other applications.
2. coat and taoc
   Colorful cat / tac outputs file lines, making it easier for the human eye to distinguish different lines.
3. a2l
   Parameters are output in color rows for easy viewing by the human eye.
4. uq
   Complete deduplication of the entire input line without reordering the input. Compared with the system's uniq command, it is enhanced that it can remove duplicates across rows without sorting input.
5. apandrp
   Batch convert file paths to absolute paths/relative paths, automatically track links and normalize paths.
6. cp-into-docker-run
   A convenience script for use with Docker . Copy the local executable file to the specified docker container and execute it in docker container .
7. tcp-connection-state-counter
   Count the number of each TCP connection status. Used to facilitate troubleshooting system connection load problems.
8. xpl and xpf
   Quickly complete the operation of opening/selecting a specified file or folder in the file browser on the command line, and optimize the operation flow between the command line and other applications.

Shell development/testing enhancements:

1. echo-args
   Output the parameters received by the script. When running on the console, the brackets surrounding the parameter values ​​are displayed in red to facilitate human viewing. Used for debugging script parameter input.
2. console-text-color-themes.sh
   Displays the effect of all text color combinations of Terminator and its printing method, which is used to develop the color output of Shell .
3. parseOpts.sh
   Command line option parsing library, enhanced support for options with multiple values ​​(i.e. arrays).

?Developer Guide

Providing useful functions to users is of course the primary value expression and reason for existence of this library.

But as an open source project, where everyone can see the source code implementation, this library may be able to do more.

Goals for developers

• Use Shell/Bash as a professional programming language for online production environments.
• It is expected to reflect the rigorous development methods and best practices of Shell/Bash scripts in production environments, and thus make it possible to demonstrate and improve the quality of Shell scripts in production environments.

PS:

• Although the above is my desired goal, I will definitely have many problems in understanding and using the Shell language, and there will also be many improvements that need to be made in these implementation scripts. We can learn, discuss and practice together ~ ?
• The scripts in this library are also implemented using Python .

About Shell scripts

The command line ( CLI ) is a tool that almost every programmer uses every day. Compared with graphical interface tools ( GUI ), the command line has its own irreplaceable convenience and advantages.

What is written on the command line is actually a Shell script. It can be said that every developer can write Shell scripts (more or less). In the implementation of functions in the production environment, Shell scripts are also often seen (although not as common as mainstream languages).

Perhaps it is because of the convenience and popularity of Shell scripts mentioned above:

• Many Shell scripts are easily implemented (including Shell scripts used in production environments);
• The implementation of Shell scripts can often be of low quality, causing serious failures online.

? Development Agreement

Shell scripts in this library:

• Use Bash 3.2+ uniformly;
• For the production environment, use rigorous and safe development methods as much as possible.

The reason why Shell uses Bash is:

• It is still the mainstream Shell and is basically deployed by default in different environments.
• In Google 's Shell Style Guide, it is clearly stated: Bash is the only shell script language that is allowed to be executed.
• Using Bash uniformly can avoid the risks and unprofitable complexity caused by the differences between different Shell .
  • There are a large number of Shell implementations, sh , bash , zsh , fish , csh , tcsh , ksh , ash , dash ...
  • Different Shell have various differences, so don’t get into them.
• Personally, I have learned Bash systemically, and I am relatively familiar with it.

PS: Although I personally use Zsh + oh-my-zsh for interactive Shell , I still use Bash for rigorous Shell script development.

Shell learning and development information

See subdocumentation for more information.

• Development specifications and tools
  • Google Shell Style Guide | Chinese version
  • koalaman/shellcheck : ShellCheck , a static analysis tool for shell scripts
  • mvdan/sh(shfmt) : shfmt formats shell programs
• ? Bash/Shell best practices and secure programming articles
  • Use the Unofficial Bash Strict Mode (Unless You Looove Debugging)
  • Bash Pitfalls: Common Mistakes in Programming - Tuanzi’s Nest: Part 1 | Part 2 | Part 3 | Part 4 | Original English text: Bash Pitfalls
  • Don't specify the sh method to execute the script yourself.
• ? Tips
  • Bash shortcut keys that allow you to improve command line efficiency [Full version]
    Supplement: ctrl + x, ctrl + e opens a text editor in place to edit the current command line, which is especially useful for complex command lines.
  • Linux Tips You Should Know | CoolShell - CoolShell
  • Simple Bash Programming Tips - Tuanzi’s Nest: Part 1 | Part 2 | Part 3
• ? Systematic learning - Reading articles and understanding Tips cannot replace systematic learning to truly understand and develop professionally!
  • 《Bash Pocket Reference》
    Highly recommended! A masterpiece that explains a simple and direct structural system, a must-have for professional Bash programming! And the second edition in 2016 has been updated to the new version of Bash 4
  • "Learning bash" expanded version of the above book
  • official information
    • bash man | Chinese version
    • Bash Reference Manual - gnu.org | Chinese version
      The Bash reference manual is comprehensive and in-depth. For example, it will comprehensively explain the differences between different escapes and the command parsing process, which helps to understand the entire execution method and process of Bash in a unified and in-depth way. These contents are often not discussed in other books (because they are complicated and difficult to explain in a simple and in-depth manner), but they are the key to understanding them all.
  • Advanced Bash-Scripting Guide: An in-depth exploration of the art of shell scripting.
  • The Art of Command Line - jlevy/the-art-of-command-line
  • awesome-lists/awesome-bash : A curated list of delightful Bash scripts and resources.
  • alebcay/awesome-shell : A curated list of awesome command-line frameworks, toolkits, guides and gizmos.
  • For more books, please see the personally organized book list Bash/Shell