小樱 发表于 2021/2/21 03:39

测试kangle中间源分发哔哩哔哩网DASH视频缓存命中率，边缘节点磁盘满了的情况，是否能正常不回源站服务器，cdnbest系统

测试kangle中间源分发哔哩哔哩网DASH视频缓存命中率，边缘节点磁盘满了的情况，是否能正常不回源站服务器，cdnbest系统


问题：
哔哩哔哩网DASH视频CDN分发在线播放所需，采用10台中间节点采用120TB磁盘缓存进行取源分发到边缘节点，800百台边缘节点采用2TB SSD固态硬盘进行分发到腾讯云CDN或阿里云CDN省内节点，最终到用户浏览器页面上进行视频播放，测试边缘节点因磁盘满载是否需要回源的命中率情况

晒一波中间节点服务器120TB配置



以下配置均采用VPS进行简化模拟测试环境，边缘节点通过DD命令，塞满硬盘，然后进行缓存观察
中间节点


边缘节点


结果：
中间节点成功命中，不进行回源到视频存储服务器，没有产生下行数据
测试数据截图


未产生回源的中间节点收到日志请求为
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/00/test1.zip?v=abcd5 HTTP/1.1" 200 49667056 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0db5dd5-7f3903ad45c0
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/05/test1.zip?v=abcd5 HTTP/1.1" 200 50947246 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0e39d82-7f3903ad5380
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/21/test1.zip?v=abcd5 HTTP/1.1" 200 54472749 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0eaf9c2-7f3903ad4ac0


产生回源的中间节点收到日志请求为
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/04/test1.zip?v=abcd5 HTTP/1.1" 200 8335064 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0e03347-7f3903ad4980
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/02/test1.zip?v=abcd5 HTTP/1.1" 200 52349458 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0e1ef6f-7f3903ad5b00
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/12/test1.zip?v=abcd5 HTTP/1.1" 200 60939918 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0e2d94c-7f3903ad5d80
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/13/test1.zip?v=abcd5 HTTP/1.1" 200 54231200 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0e8a488-7f3903ad59c0
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/07/test1.zip?v=abcd5 HTTP/1.1" 200 57214345 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0e9478c-7f3903ad5d80
111.58.168.22 - - "GET https://www.itzmx.com/post/archives/00/48/test1.zip?v=abcd5 HTTP/1.1" 200 50995649 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" 177c0ea7711-7f3903ad5d80


可以观察到未产生回源的日志标识
和产生回源的日志标识、、、、、的区别，猜测后几位数为文件校验码？不过我测了MD5，SHA1，CRC32均不对，可能是随机数，搭建的测试服务器观察到有3到4位


关于kangle日志标识代号的一些疑问
https://bbs.itzmx.com/thread-94114-1-1.html

不可名 发表于 2021/2/21 20:22

{:3038:}
页: [1]
查看完整版本: 测试kangle中间源分发哔哩哔哩网DASH视频缓存命中率，边缘节点磁盘满了的情况，是否能正常不回源站服务器，cdnbest系统