本文總結了伺服器產業的過去、現在和未來趨勢。我目前的工作與伺服器產業高度相關，並且因為我的工作，我能夠從Hyperscalers、OMD、OEM以及主要IC組件供應商（CPU、GPU、BMC、Memory、 ETC…）。本論文的主題包括伺服器展望、伺服器市場趨勢、挑戰、機會、案例研究和未來展望。
所有數據和資訊均來自Hyperscalers、OMD、OEM、主要IC組件供應商以及國際知名研究機構（IDC、Gartner、Digitimes、TrendForce、摩根士丹利等）。從我的觀察和收集的數據來看，由於人工智慧伺服器需求的出現，伺服器產業正在轉變為一個新的生態系統，競爭力正在重新洗牌。
總而言之，本文將引導您更了解伺服器產業現狀、趨勢以及晶片製造商和超大規模企業如何應對當前供應鏈挑戰的策略。

This thesis summarizes the past, current, and future trend in the server industry. My current job is highly related to server industry, and because of my job, I am able to glimpse into the technology trend and supply chain status from Hyperscalers, OMDs, OEMs, and major IC component vendors (CPU, GPU, BMC, Memory, etc…). This thesis will cover topics including server outlook, server market trend, challenges, opportunities, case study, and future outlook.
All the data and information were collected from Hyperscalers, OMDs, OEMs, major IC component vendors, and internationally renowned research institute (IDC, Gartner, Digitimes, TrendForce, Morgan Stanley, etc…). From my observation and the data I collected, I am seeing server industry is transforming into a new ecosystem and competitiveness is being reshuffled because of the emerging of AI server demand.
In conclusion, this thesis will lead you to better understand the server industry status, trend and how chip makers and Hyperscalers’s strategy to fit in the current supply chain challenges.

1. Digitimes, Research, 全球產業數據, 伺服器出貨量
https://www.digitimes.com.tw/tech/rpt/datacharts.asp?CnlID=3
2. ID, IDC Corporate, Device Market Trends, Current: Servers Market Insight
https://www.idc.com/promo/servers
3. TechTarget, Data Center, Dive into the history of server hardware
https://www.techtarget.com/searchdatacenter/feature/Dive-into-the-history-of-server-hardware
4. Stock Analysis, NVIDIA, AMD, Intel
https://stockanalysis.com/stocks/nvda/market-cap/
5. Energy.Gov, Department of Energy, DOE Announces $40 Million for More Efficient Cooling for Data Centers
https://www.energy.gov/articles/doe-announces-40-million-more-efficient-cooling-data-centers#:~:text=Used%20to%20house%20computers%2C%20storage%20systems%2C%20and%20computing,to%2040%25%20of%20data%20center%20energy%20usage%20overall
6. Intel Q2 Product Roadmap (Data Center)
7. AMD Q2 Product Roadmap (Data Center)
8. NVIDIA Q2 Product Roadmap (Data Center)
9. Samsung Q2 Product Roadmap (Server)
10. Samsung Q2 General Market report
11. Gigabyte, Insight, Glossary, OCP
https://www.gigabyte.com/tw/Glossary/ocp?lan=en#:~:text=OCP%20server%20and%20rack%20infrastructure%20has%20been%20designed,supplies%20needed%20and%20decreasing%20management%20and%20management%20costs%29
12. Gigabyte, 首頁, 企業應用, GPU 協同運算伺服器
https://www.gigabyte.com/tw/Enterprise/GPU-Server?fid=2235
13. Digitimes, 受惠雲端資料中心自研晶片、AI訓練與推論需求　2021~2025年Arm伺服器CPU出貨CAGR估達49.5%
https://www.digitimes.com.tw/tech/rpt/rpt_show.asp?cnlid=3&v=20230828-343&n=1&cat=SVR
14. Gigabyte, 規劃資料中心冷卻方案時 不可不知的5個關鍵知識
https://www.gigabyte.com/tw/Article/5-must-know-technical-terms-before-you-choose-data-center-cooling-solutions
15. Intel, CPU 散熱器：水冷式 Vs. 氣冷式
https://www.intel.com.tw/content/www/tw/zh/gaming/resources/cpu-cooler-liquid-cooling-vs-air-cooling.html
16. Gigabyte, 如何挑選適當的伺服器冷卻方案？ 技嘉科技《科技指南》系列文章
https://www.gigabyte.com/tw/Article/how-to-pick-a-cooling-solution-for-your-servers-a-tech-guide-by-gigabyte
17. Gigabyte, Liquid Cooling | 液體冷卻
https://www.gigabyte.com/tw/Glossary/liquid-cooling
18. Alamy, Immersion cooling Stock Photos and Images
https://www.alamy.com/stock-photo/immersion-cooling.html?sortBy=relevant
19. Gigabyte, Immersion Cooling | 浸沒式冷卻
https://www.gigabyte.com/tw/Glossary/immersion-cooling
20. Samsung Server ODMs Sensing Report
21. Morgan Stanley Research- AI Industry Outlook
22. TrendForce Research- 2023 Revenue ranking top 10 of IC design house
https://www.trendforce.com/presscenter/news/20240509-12134.html
23. TrendForce Research- 2022 Revenue ranking top 10 of IC design house
https://www.trendforce.com/presscenter/news/20220609-11245.html#:~:text=According%20to%20the%20latest%20TrendForce%20statistics%2C%20the%20top,Qualcomm%2C%20NVIDIA%2C%20Broadcom%20ranked%20in%20the%20top%20three.
24. 聯合新聞網, 臺灣代工AI伺服器佔全球出貨9成 2024有2大成長動能
https://udn.com/news/story/7240/7700860
25. European Commision, JRC news and updates, The EU Code of Conduct for Data Centres – towards more innovative, sustainable and secure data centre facilities
https://joint-research-centre.ec.europa.eu/jrc-news-and-updates/eu-code-conduct-data-centres-towards-more-innovative-sustainable-and-secure-data-centre-facilities-2023-09-05_en
26. DCOI Compliance: A Guide to Improving PUE in U.S. Federal Data Centers
https://www.apc.com/us/en/support/resources-tools/white-papers/dcoi-compliance-a-guide-to-improving-pue-in-us-federal-data-centers.jsp
27. US, Europe, Japan make PUE official metric for data center energy efficiency
https://www.datacenterdynamics.com/en/news/us-europe-japan-make-pue-official-metric-for-data-center-energy-efficiency/
28. ISO/IEC 30134-2, First edition 2016-04-15
https://webstore.iec.ch/preview/info_isoiec30134-2%7Bed1.0%7Den.pdf
29. Official Microsoft Blog, Microsoft will be carbon negative by 2030
https://blogs.microsoft.com/blog/2020/01/16/microsoft-will-be-carbon-negative-by-2030/
30. TrendForce, Global AI Server Shipments Forecasted to Increase 40% in 2023 amid Rising AI Demand, Says TrendForce
https://www.trendforce.com/presscenter/news/20230530-11692.html
31. Delta Computer
https://www.deltacomputer.com
32. NVIDIA H100 Product Spec sheet
https://resources.nvidia.com/en-us-tensor-core
33. AMD Mi300X Product Spec sheet
https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/data-sheets/amd-instinct-mi300x-data-sheet.pdf
34. AMD CEO Lisa Su Keynote in Computex 2024
https://www.youtube.com/watch?v=MCi8jgALPYA
35. NVIDIA CEO Jenson Huang Keynote in Computex 2024
https://www.youtube.com/watch?v=pKXDVsWZmUU&t=2184s
36. NVIDIA Computex 2024 Keynote NVIDIA Rubin GPU Vera CPU and 1.6T Networking
https://www.servethehome.com/nvidia-computex-2024-keynote/
37. Hyperscalers forge ahead with in-house semiconductor solutions amidst Nvidia dependency concerns, says GlobalData
https://www.globaldata.com/media/technology/hyperscalers-forge-ahead-with-in-house-semiconductor-solutions-amidst-nvidia-dependency-concerns-says-globaldata/
38. The Ojo-Yoshida Report, Everyone Hates ASIC, But Hyperscalers Want Them
https://ojoyoshidareport.com/everyone-hates-asic-but-hyperscalers-want-them/
39. Digitimes, CSP大廠AI資本支出成長　ASIC生意前景佳
https://www.digitimes.com.tw/tech/dt/n/shwnws.asp?CnlID=1&id=689964&query=asic
40. Digitimes, 聯發科1Q24營收、獲利攀升　全年能見度轉好
https://www.digitimes.com.tw/tech/dt/n/shwnws.asp?CnlID=1&id=691093&query=asic
41. TrendForce, [News] Amazon Unveils New AWS-Designed Chips, Boosting Orders for TSMC and ALCHIP
https://www.trendforce.com/news/2023/11/30/news-amazon-unveils-new-aws-designed-chips-boosting-orders-for-tsmc-and-alchip/
42. Tech giants form AI group to counter Nvidia with new interconnect standard
https://arstechnica.com/information-technology/2024/05/tech-giants-form-ai-group-to-counter-nvidia-with-new-interconnect-standard/
43. Taiwan server ODMs diversifying abroad
https://www.electronicsweekly.com/news/business/taiwan-server-odms-diversifying-abroad-2023-08/
44. 地緣政治助力 全球投資新熱點 東南亞崛起 驅動全球經濟成長動能
https://www.ieatpe.org.tw/magazine/ebook390/coverstory-1.html
45. How the energy crisis started, how global energy markets are impacting our daily life, and what governments are doing about it, Global Energy Crisis
https://www.iea.org/topics/global-energy-crisis
46. THE WEEK, Is America running out of electrical power?
https://theweek.com/environment/electrical-power-risks-grid-america-artificial-intelligence-climate
47. Supermicro White Paper, Liquid Cooling solution
https://www.supermicro.com/white_paper/white_paper_Liquid-Cooling-Solutions.pdf?pdf
48. How Microsoft measures datacenter water and energy use to improve Azure Cloud sustainability
https://azure.microsoft.com/en-us/blog/how-microsoft-measures-datacenter-water-and-energy-use-to-improve-azure-cloud-sustainability/
49. Sharing the latest improvements to efficiency in Microsoft’s datacenters
https://azure.microsoft.com/en-us/blog/sharing-the-latest-improvements-to-efficiency-in-microsoft-s-datacenters/
50. To cool datacenter servers, Microsoft turns to boiling liquid
https://news.microsoft.com/source/features/innovation/datacenter-liquid-cooling/
51. Cooling Accounts for Nearly Half of Data Center Power Load
https://blog.datacentersystems.com/sustainable-cooling-solutions-for-data-centers-from-air-to-liquid-cooling