URLBook

URLBook is a sample project of URL-shortener platform with focus on backend side.

• URLBook
  • System design
    • Functional requirement
    • Non-Functional requirement
    • High-level Design Diagram
  • Project architecture
  • How to run the project
    • Setup Running Environment
    • Run the project
    • Run the project for development
  • Milestones
  • Benchmark result

System design

Functional requirement

• There should be an API (without OAuth action) that user can submit a valid URL for shortening.
• Shorted URL can have a system generated phrase or user customized value.
• The limitation for system generated phrase is up to 7 character
• The limitation for user customized phrase is up to 16 character
• The Shorted URL will not expire
• Shorted URL must redirect to the destination with status of 302
• With having shorted URL, can monitor the number of clicks and the device types which used for browse the link.

Non-Functional requirement

• System should be highly available (99.9% uptime)
• 500k url submitted to the system per day
• 200M redirection request per month ( 200M / (30Day * 24h * 3600s) = 80tps )

High-level Design Diagram

Project architecture

As considered, Hexagonal Architecture selected for project structure to make the project flexible and isolated its parts.

Here are some links about the architecture:

• https://medium.com/@pthtantai97/hexagonal-architecture-with-golang-part-1-7f82a364b29
• https://medium.com/@pthtantai97/hexagonal-architecture-with-golang-part-2-681ee2a0d780
• https://herbertograca.com/2017/11/16/explicit-architecture-01-ddd-hexagonal-onion-clean-cqrs-how-i-put-it-all-together/

How to run the project

Setup Running Environment

1. You at least need to have docker and docker-compose installed.
2. Run the following command in the project directory to setup the environment variable

   make prepare
   or if you don't have make installed, run the following

   bash ./scripts/prepare.bash

Run the project

In order to run the project, use this command:

docker-compose -f ./deployments/docker-compose.yml --env-file ./.env up

Run the project for development

For running in development mode, you should have golang >= 1.21 installed on your machine. After running the previous instruction

• Use the following to setup the require services

  docker-compose -f ./deployments/docker-compose.dev.yml --env-file ./.env up
• To run the project in watch mode, execute the following command: make dev_server

Milestones

• Create project system design
• Setup required services with docker-compose
  • Database (mysql)
  • Cache (memcached)
• Only submit a url and get a system generated short url
• Redirect the system generated short-url to its original url with 302 HTTP status code
• Submit a url with custom name for shortening
• Bring caching mechanism
• Add some tracking mechanism on urls
  • Number of clicks with date
  • The devices used to visit the link
  • The IP address that clicks happened from

Benchmark result

Apache benchmark (ab) tool used for benchmarking the project, and how many request per second it can handle.

Server Software:        
Server Hostname:        localhost
Server Port:            3000

Document Path:          /L4ryUrj
Document Length:        0 bytes

Concurrency Level:      80
Time taken for tests:   2.510 seconds
Complete requests:      10000
Failed requests:        0
Non-2xx responses:      10000
Total transferred:      6450000 bytes
HTML transferred:       0 bytes
Requests per second:    3983.90 [#/sec] (mean)
Time per request:       20.081 [ms] (mean)
Time per request:       0.251 [ms] (mean, across all concurrent requests)
Transfer rate:          2509.39 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   1.1      0      26
Processing:     1   19  12.4     16     100
Waiting:        1   19  12.4     16     100
Total:          1   20  12.4     17     101

Percentage of the requests served within a certain time (ms)
  50%     17
  66%     21
  75%     23
  80%     26
  90%     35
  95%     47
  98%     59
  99%     67
 100%    101 (longest request)