一起学习用Verilog在FPGA上实现CNN----(七)全连接层设计

分手后的思念是犯贱 2023-09-24 17:24 58阅读 0赞

# 1 全连接层设计 #

## 1.1 Layer ##

进行线性计算的单元layer，原理图如图所示：

![在这里插入图片描述][5f09fecc444647eab50f367fdcb95ba3.png_pic_center]

## 1.2 processingElement ##

Layer中的线性计算单元processingElement，原理图如图所示：

![在这里插入图片描述][8110e92aa05741a4aa9ab2e9c517bbbb.png_pic_center]  
processingElement模块展开原理图，如图所示，包含一个乘法器和一个加法器，对输入进行累乘和累加

![在这里插入图片描述][27038936c1fc48279ea5a37cd30cfbaf.png_pic_center]

## 1.3 weightMemory ##

全连接层的权重存储于weightMemory单元，原理图如图所示：

![在这里插入图片描述][9dd6227f315d476d8566672940105b57.png_pic_center]

# 2 代码实现 #

## 2.1 weightMemory ##

### 2.1.1 设计输入 ###

创建weightMemory文件，操作如图：

![在这里插入图片描述][5d374046dff84f77b42c097e936334a4.png_pic_center]

双击打开，输入代码：

module weightMemory(clk,address,weights);
    
    parameter DATA_WIDTH = 32;
    parameter INPUT_NODES = 100;
    parameter OUTPUT_NODES = 32;
    parameter file = "E:/FPGA_Learn/FPGA/Day1211/Weight/weightsdense_1_IEEE.txt";
    
    localparam TOTAL_WEIGHT_SIZE = INPUT_NODES * OUTPUT_NODES;
    
    input clk;
    input [7:0] address;
    output reg [DATA_WIDTH*OUTPUT_NODES-1:0] weights;
    
    reg [DATA_WIDTH-1:0] memory [0:TOTAL_WEIGHT_SIZE-1];
    
    integer i;
    
    always @ (posedge clk) begin	
    	if (address > INPUT_NODES-1 || address < 0) begin
    		weights = 0;
    	end else begin
    		for (i = 0; i < OUTPUT_NODES; i = i + 1) begin
    			weights[(OUTPUT_NODES-1-i)*DATA_WIDTH+:DATA_WIDTH] = memory[(address*OUTPUT_NODES)+i];
    		end
    	end
    end
    
    initial begin
    	$readmemh(file,memory);
    end
    
    endmodule

如图所示：

![在这里插入图片描述][758167d06ea3414d8b04a86c2f11ed09.png_pic_center]

### 2.1.2 分析与综合 ###

将weightMemory设置为顶层：

![在这里插入图片描述][2246dd618e6a4150938c1b97a328240f.png_pic_center]

关闭上次分析文件：

![在这里插入图片描述][316e83ef6d8e41db8cb30f3a041570c4.png_pic_center]

对设计进行分析，操作如图：

![在这里插入图片描述][8f1a50c19b5a4c0aabe821d1eb778843.png_pic_center]

分析后的设计，Vivado自动生成原理图，如图：

![在这里插入图片描述][f32622ab9eb543128e7a8d22610bb1ed.png_pic_center]

原理图如图：

![在这里插入图片描述][2cb92f6043094f8f90c1ab008bccec63.png_pic_center]

对设计进行综合，操作如图：

![在这里插入图片描述][04211d6fa84142a4a1b7d0dccf37520c.png_pic_center]

综合完成，关闭即可

### 2.1.3 功能仿真 ###

创建仿真激励文件，操作如图：

![在这里插入图片描述][b8b6381bb2bb471eaf749c8b5ffbe195.png_pic_center]

双击打开，输入激励代码：

module tb_weightMemroy();
    
    reg clk;
    reg [6:0] address;
    wire [32*32-1:0] weights;
    
    localparam PERIOD = 100;
    
    always
    	#(PERIOD/2) clk = ~clk;
    
    initial begin
    	#0
    	clk = 1'b0;
    	address = 0;
    
    	#PERIOD
    	address = 1;
    
    	#PERIOD 
    	address = 2;
    
    	#PERIOD
    	address = 32;
    
    	#PERIOD
    	$stop;
    end
    
    weightMemory UUT
    (
    	.clk(clk),
    	.address(address),
    	.weights(weights)
    );
    
    endmodule

如图所示：

![在这里插入图片描述][d0d1b4636e214715b183cc7bd304ec88.png_pic_center]  
将tb\_weightMemory设置为顶层：

![在这里插入图片描述][52f5180c17824b09a50fc137d381c483.png_pic_center]

开始进行仿真，操作如下：

![在这里插入图片描述][7a05980e025a46b392ad8c5a1902a258.png_pic_center]

仿真波形，如图：

![在这里插入图片描述][29b3c30f520b4ccf8bb9ce9818cb80e9.png_pic_center]

仿真结束，关闭仿真：

![在这里插入图片描述][d9fbfff2494a4b96983a181690fb7472.png_pic_center]

## 2.2 processingElement ##

### 2.2.1 设计输入 ###

创建processingElement文件，操作如图：

![在这里插入图片描述][42e9ae1ea22e47cca0f23d3ec1c8eb45.png_pic_center]

双击打开，输入代码：

module processingElement(clk,reset,floatA,floatB,result);
    
    parameter DATA_WIDTH = 32;
    
    input clk, reset;
    input [DATA_WIDTH-1:0] floatA, floatB;
    output reg [DATA_WIDTH-1:0] result;
    
    wire [DATA_WIDTH-1:0] multResult;
    wire [DATA_WIDTH-1:0] addResult;
    
    floatMult FM (floatA,floatB,multResult);
    floatAdd FADD (multResult,result,addResult);
    
    always @ (posedge clk or posedge reset) begin
    	if (reset == 1'b1) begin
    		result = 0;
    	end else begin
    		result = addResult;
    	end
    end
    
    endmodule

如图所示：

![在这里插入图片描述][47f73547719d461db552e6cb1f49f4df.png_pic_center]

### 2.2.2 分析与综合 ###

将processingElement设置为顶层：

![在这里插入图片描述][ec3b06cad9e94a4ca3938649e0da1666.png_pic_center]

对设计进行分析，操作如图：

![在这里插入图片描述][273c26697c8244e292c818d4f3a6266e.png_pic_center]

分析后的设计，Vivado自动生成原理图，如图：

![在这里插入图片描述][b72de4b6b7d44b9db2eb9c294fb3f9c0.png_pic_center]

对设计进行综合，操作如图：

![在这里插入图片描述][35b4ceded44e4cb1853e5a11f7668a5d.png_pic_center]

综合完成，关闭即可：

![在这里插入图片描述][1ff0d42747284c76ba112f0ab044281d.png_pic_center]

### 2.2.3 功能仿真 ###

创建仿真激励文件，操作如图：

![在这里插入图片描述][d08773af052743378698294ca9051282.png_pic_center]

双击打开，输入激励代码：

module tb_processingElement();
    
    reg clk,reset;
    reg [31:0] floatA, floatB;
    wire [31:0] result;
    
    localparam PERIOD = 100;
    
    always
    	#(PERIOD/2) clk = ~clk;
    
    initial begin
    	#0
    	clk = 1'b0;
    	reset = 1;
    	// A = 2 , B = 3
    	floatA = 32'b01000000000000000000000000000000;
    	floatB = 32'b01000000010000000000000000000000;
    
    	#(PERIOD/4)
    	reset = 0;
    
    	// A = 1 , B = 5
    	#(3*PERIOD/4)
    	floatA = 32'b00111111100000000000000000000000;
    	floatB = 32'b01000000101000000000000000000000;
    
    	#(3*PERIOD/2)
    	reset = 1;
    
    	#(PERIOD)
    	$stop;	
    end
    
    processingElement PE 
    (
    	.clk(clk),
    	.reset(reset),
    	.floatA(floatA),
    	.floatB(floatB),
    	.result(result)
    );
    
    endmodule

如图所示：

![在这里插入图片描述][26b7104b3e314b81ab4a29d9fc4596a1.png_pic_center]  
将tb\_processingElement设置为顶层：

![在这里插入图片描述][f8e75fcc98ca4298bb02fc023512ed86.png_pic_center]

开始进行仿真，操作如下：

![在这里插入图片描述][321b50b9e3de4216ab280c571e900bfd.png_pic_center]

仿真波形，如图：

![在这里插入图片描述][56884615fd4a43f1aad3ded16dca8e6a.png_pic_center]

仿真结束，关闭仿真：

![在这里插入图片描述][a6c81f2a6a5a498fb205c87ba3c9634a.png_pic_center]

## 2.3 Layer ##

### 2.3.1 设计输入 ###

创建Layer文件，操作如图：

![在这里插入图片描述][81ccd26d8ff442c5aa098cdb342a8fdb.png_pic_center]

输入文件名：

![在这里插入图片描述][fffb46b26c41461f8d68751e392c5cc1.png_pic_center]  
确定创建：

![在这里插入图片描述][3fb4a638164549228ec7d1199ac84ebb.png_pic_center]

双击打开，输入代码：

module layer(clk,reset,input_fc,weights,output_fc);
    
    parameter DATA_WIDTH = 32;
    parameter INPUT_NODES = 100;
    parameter OUTPUT_NODES = 32;
    
    input clk, reset;
    input [DATA_WIDTH*INPUT_NODES-1:0] input_fc;
    input [DATA_WIDTH*OUTPUT_NODES-1:0] weights;
    output [DATA_WIDTH*OUTPUT_NODES-1:0] output_fc;
    
    reg [DATA_WIDTH-1:0] selectedInput;
    integer j;
    
    genvar i;
    
    generate
    	for (i = 0; i < OUTPUT_NODES; i = i + 1) begin
    		processingElement PE 
    		(
    			.clk(clk),
    			.reset(reset),
    			.floatA(selectedInput),
    			.floatB(weights[DATA_WIDTH*i+:DATA_WIDTH]),
    			.result(output_fc[DATA_WIDTH*i+:DATA_WIDTH])
    		);
    	end
    endgenerate
    
    always @ (posedge clk or posedge reset) begin
    	if (reset == 1'b1) begin
    		selectedInput = 0;
    		j = INPUT_NODES - 1;
    	end else if (j < 0) begin
    		selectedInput = 0;
    	end else begin
    		selectedInput = input_fc[DATA_WIDTH*j+:DATA_WIDTH];
    		j = j - 1;
    	end
    end
    
    endmodule

如图所示：

![在这里插入图片描述][c887d030c7b14a51bf914f916242a75c.png_pic_center]

### 2.3.2 分析与综合 ###

将Layer设置为顶层：

![在这里插入图片描述][d6d381ff211641c19845bed3712e33e3.png_pic_center]  
关闭上次的分析文件：

![在这里插入图片描述][98810f74e9584403946080fa69bfa968.png_pic_center]

对设计进行分析，操作如图：

![在这里插入图片描述][0816dbd64e68444cbe72b052d391c74e.png_pic_center]

分析后的设计，Vivado自动生成原理图，如图：

![在这里插入图片描述][0e4710b33b0f4af5b51a464321dc154d.png_pic_center]

原理图如图：

![在这里插入图片描述][6ea53801ffb3479ea0141b9ba4b26f5a.png_pic_center]

对设计进行综合，操作如图：

![在这里插入图片描述][3d252353d50c4edc9c0188ab087ffece.png_pic_center]

综合完成，关闭即可：

![在这里插入图片描述][8fa7620073ef49ffa5cd8b397d4f23bf.png_pic_center]

### 2.3.3 功能仿真 ###

创建仿真激励文件，操作如图：

![在这里插入图片描述][2c321b81c55a451e92958eeb9954663a.png_pic_center]

双击打开，输入激励代码：

module tb_layer();
    reg clk, reset;
    reg [32*100-1:0] input_fc;
    wire [32*32-1:0] weights;
    wire [32*32-1:0] output_fc;
    
    reg [7:0] address;
    
    localparam PERIOD = 100;
    
    always
    	#(PERIOD/2) clk = ~clk;
    
    always @ (posedge clk or posedge reset) begin
    	if (reset == 1'b1) begin
    		address = 0;
    	end else begin
    		address = address + 1;
    	end
    end
    
    weightMemory WM 
    (
    	.clk(clk),
    	.address(address),
    	.weights(weights)
    );
    
    initial begin
    	#0
    	clk = 1'b0;
    	reset = 1'b1;
    	input_fc = 3200'b00111110110101101010010110110100001111110011010001110101011100000011111100101101101110010110001000111110101011101000010101010100001111110110000001111111101110100011111011000011010010010111101000111111011111001000101111111100001111110111001000101111111000000011111101011010001000111010111000111111011101000000011111101110001111100010111111011001011101100011111100000010101100110000001000111110101010010111100101011010001111101100110010000101101000000011111101111011101001111111110000111110011010111101000111101110001111110110011010000011110100100011111101101111110100011101110000111110101011011010100101100100001111100001000110100001000100100011111100010001101100110010100000111111001011100010000101100100001111110111100011001101111010100011111010100100100001010011110000111111010011010100111110011100001111110010101001000011010101100011111101111100000000000000000000111110101010001011100101010110001111110100110001101111100111000011111000001100010010010011010000111111000110110111111100111000001111011001010011100001001010100011111100001100000001110001010000111111000000111101100100000010001111110110111100001011111000000011111100111000110101110110101000111111001011110010100101011110001111110110111101110111111000100011111101101001101000011100101000111111010110110100010110111110001111110011000111010101010111100011111101001000000100011001000000111110110001001110100110000000001111101111011010111101111101000011111011110100011110011111011000111101110110011001000110111100001111101110000100001101101111100011110110101010011000010101101000111111010100001000110110100000001111101011010011101101011100000011111101100000101000011011111000111110101110111001010110000000001111110100010100110011100011100011111010010001011000010001110000111101010111101000000110110000001111110101100010001101101100000011111100001101101010010010001000111111000000111001100100001010001111110110010011011011110011100011111101101111001100111101101000111111010111111011100110111110001111110001000111101011001000000011111010110001110010010111000000111111001100001010001101100010001111101010011010010001010000100011111101011110000100111100001000111101101000101100000101000110001111110110000011111011110010100011111101010010101000111010110000111111000001010101101100000010001111110010101100000101010100100011111100000001111101010000011000111111001000010011100101000010001111101100011100001101100001000011110110111001100100010111100000111110111101111001110111110100001110110111000000000001110110100011111010000110000011010000001000111111010010010011011110001110001111110000111010110101000111000011111101111101111010111111101000111111000110011001101100101100001111011000101110000001000101000011111001010010100010011001100000111110110100011001010110101010001111110011100101111011011101000011111000110011010110010111100000111111000110111101100100110100001111110000011101111011000001100011111101011111000000111100000000111111001110111111111101111010001111101100001101100101100010000011111100000100011111010000101000111100001100111000000100110110001111110110110010100011110101100011111001011000011110011100010000111110000100101010000100110000001111110101100001110101101101000011110111101101011100011111001000111101011101111110000111101110;
    
    	#PERIOD
    	reset = 1'b0;
    	
    
    	#(102*PERIOD)
    	$stop;
    end
    
    layer UUT
    (
    	.clk(clk),
    	.reset(reset),
    	.input_fc(input_fc),
    	.weights(weights),
    	.output_fc(output_fc)
    );
    endmodule

如图所示：

![在这里插入图片描述][5b2ba5c87974417c8a2893db7182c088.png_pic_center]

将tb\_layer设置为顶层：

![在这里插入图片描述][01dfc7b8d77d491b8320940191b22700.png_pic_center]

开始进行仿真，操作如下：

![在这里插入图片描述][5d5988ae229b48bf9167e134670f7222.png_pic_center]

仿真波形，如图：

![在这里插入图片描述][d7a5c299c4a14fd2a954fa1d31249c20.png_pic_center]

仿真结束，关闭仿真：

![在这里插入图片描述][d7a57f53d45f4bed937600f9c03db639.png_pic_center]

## 2.4 integrationFC ##

### 2.4.1 设计输入 ###

打开integrationFC文件，输入代码：

module integrationFC(clk,reset,iFCinput,CNNoutput);
    
    parameter DATA_WIDTH = 32;
    parameter IntIn = 120;
    parameter FC_1_out = 84;
    parameter FC_2_out = 10;
    
    input clk, reset;
    input [IntIn*DATA_WIDTH-1:0] iFCinput;
    output [FC_2_out*DATA_WIDTH-1:0] CNNoutput;
    
    wire [FC_1_out*DATA_WIDTH-1:0] fc1Out;
    wire [FC_1_out*DATA_WIDTH-1:0] fc1OutTanh;
    
    wire [FC_2_out*DATA_WIDTH-1:0] fc2Out;
    wire [FC_2_out*DATA_WIDTH-1:0] fc2OutSMax;
    
    wire [DATA_WIDTH*FC_1_out-1:0] wFC1;
    wire [DATA_WIDTH*FC_2_out-1:0] wFC2;
    
    reg FC1reset;
    reg FC2reset;
    reg SMaxEnable;
    wire DoneFlag;
    
    reg [7:0] address1;
    
    weightMemory 
    #(.INPUT_NODES(IntIn),
      .OUTPUT_NODES(FC_1_out),
      .file("E:/FPGA_Learn/FPGA/Day1211/Weight/weightsdense_1_IEEE.txt"))
      W1(
        .clk(clk),
        .address(address1),
        .weights(wFC1)
        );
        
    layer
    #(.INPUT_NODES(IntIn),
      .OUTPUT_NODES(FC_1_out))
     FC1(
        .clk(clk),
        .reset(FC1reset),
        .input_fc(iFCinput),
        .weights(wFC1),
        .output_fc(fc1Out)
        );
    layer
    #(.INPUT_NODES(FC_1_out),
      .OUTPUT_NODES(FC_2_out))
     FC2(
        .clk(clk),
        .reset(FC2reset),
        .input_fc(fc1OutTanh),
        .weights(wFC2),
        .output_fc(fc2Out)
        );    
    softmax SMax(
          .inputs(fc2Out),
          .clk(clk),
          .enable(SMaxEnable),
          .outputs(CNNoutput),
          .ackSoft(DoneFlag)
          );
          
    endmodule

如图所示：

![在这里插入图片描述][f31bc976306442a09fd03833412f2af4.png_pic_center]

### 2.4.2 分析与综合 ###

将integrationFC设置为顶层：

![在这里插入图片描述][f9780f068c424bf58f4cd8893912ab30.png_pic_center]

关闭上次的分析文件：

![在这里插入图片描述][10f53198ace8462f80a7afebccfc3a42.png_pic_center]

对设计进行分析，操作如图：

![在这里插入图片描述][c0ed62c2d14e4de8a227cec91b0e2f97.png_pic_center]

分析后的设计，Vivado自动生成原理图，如图：

![在这里插入图片描述][6654e2baa85745daa664af202501510d.png_pic_center]

**希望本文对大家有帮助，上文若有不妥之处，欢迎指正**

**分享决定高度，学习拉开差距**

[5f09fecc444647eab50f367fdcb95ba3.png_pic_center]: https://img-blog.csdnimg.cn/5f09fecc444647eab50f367fdcb95ba3.png#pic_center
[8110e92aa05741a4aa9ab2e9c517bbbb.png_pic_center]: https://img-blog.csdnimg.cn/8110e92aa05741a4aa9ab2e9c517bbbb.png#pic_center
[27038936c1fc48279ea5a37cd30cfbaf.png_pic_center]: https://img-blog.csdnimg.cn/27038936c1fc48279ea5a37cd30cfbaf.png#pic_center
[9dd6227f315d476d8566672940105b57.png_pic_center]: https://img-blog.csdnimg.cn/9dd6227f315d476d8566672940105b57.png#pic_center
[5d374046dff84f77b42c097e936334a4.png_pic_center]: https://img-blog.csdnimg.cn/5d374046dff84f77b42c097e936334a4.png#pic_center
[758167d06ea3414d8b04a86c2f11ed09.png_pic_center]: https://img-blog.csdnimg.cn/758167d06ea3414d8b04a86c2f11ed09.png#pic_center
[2246dd618e6a4150938c1b97a328240f.png_pic_center]: https://img-blog.csdnimg.cn/2246dd618e6a4150938c1b97a328240f.png#pic_center
[316e83ef6d8e41db8cb30f3a041570c4.png_pic_center]: https://img-blog.csdnimg.cn/316e83ef6d8e41db8cb30f3a041570c4.png#pic_center
[8f1a50c19b5a4c0aabe821d1eb778843.png_pic_center]: https://img-blog.csdnimg.cn/8f1a50c19b5a4c0aabe821d1eb778843.png#pic_center
[f32622ab9eb543128e7a8d22610bb1ed.png_pic_center]: https://img-blog.csdnimg.cn/f32622ab9eb543128e7a8d22610bb1ed.png#pic_center
[2cb92f6043094f8f90c1ab008bccec63.png_pic_center]: https://img-blog.csdnimg.cn/2cb92f6043094f8f90c1ab008bccec63.png#pic_center
[04211d6fa84142a4a1b7d0dccf37520c.png_pic_center]: https://img-blog.csdnimg.cn/04211d6fa84142a4a1b7d0dccf37520c.png#pic_center
[b8b6381bb2bb471eaf749c8b5ffbe195.png_pic_center]: https://img-blog.csdnimg.cn/b8b6381bb2bb471eaf749c8b5ffbe195.png#pic_center
[d0d1b4636e214715b183cc7bd304ec88.png_pic_center]: https://img-blog.csdnimg.cn/d0d1b4636e214715b183cc7bd304ec88.png#pic_center
[52f5180c17824b09a50fc137d381c483.png_pic_center]: https://img-blog.csdnimg.cn/52f5180c17824b09a50fc137d381c483.png#pic_center
[7a05980e025a46b392ad8c5a1902a258.png_pic_center]: https://img-blog.csdnimg.cn/7a05980e025a46b392ad8c5a1902a258.png#pic_center
[29b3c30f520b4ccf8bb9ce9818cb80e9.png_pic_center]: https://img-blog.csdnimg.cn/29b3c30f520b4ccf8bb9ce9818cb80e9.png#pic_center
[d9fbfff2494a4b96983a181690fb7472.png_pic_center]: https://img-blog.csdnimg.cn/d9fbfff2494a4b96983a181690fb7472.png#pic_center
[42e9ae1ea22e47cca0f23d3ec1c8eb45.png_pic_center]: https://img-blog.csdnimg.cn/42e9ae1ea22e47cca0f23d3ec1c8eb45.png#pic_center
[47f73547719d461db552e6cb1f49f4df.png_pic_center]: https://img-blog.csdnimg.cn/47f73547719d461db552e6cb1f49f4df.png#pic_center
[ec3b06cad9e94a4ca3938649e0da1666.png_pic_center]: https://img-blog.csdnimg.cn/ec3b06cad9e94a4ca3938649e0da1666.png#pic_center
[273c26697c8244e292c818d4f3a6266e.png_pic_center]: https://img-blog.csdnimg.cn/273c26697c8244e292c818d4f3a6266e.png#pic_center
[b72de4b6b7d44b9db2eb9c294fb3f9c0.png_pic_center]: https://img-blog.csdnimg.cn/b72de4b6b7d44b9db2eb9c294fb3f9c0.png#pic_center
[35b4ceded44e4cb1853e5a11f7668a5d.png_pic_center]: https://img-blog.csdnimg.cn/35b4ceded44e4cb1853e5a11f7668a5d.png#pic_center
[1ff0d42747284c76ba112f0ab044281d.png_pic_center]: https://img-blog.csdnimg.cn/1ff0d42747284c76ba112f0ab044281d.png#pic_center
[d08773af052743378698294ca9051282.png_pic_center]: https://img-blog.csdnimg.cn/d08773af052743378698294ca9051282.png#pic_center
[26b7104b3e314b81ab4a29d9fc4596a1.png_pic_center]: https://img-blog.csdnimg.cn/26b7104b3e314b81ab4a29d9fc4596a1.png#pic_center
[f8e75fcc98ca4298bb02fc023512ed86.png_pic_center]: https://img-blog.csdnimg.cn/f8e75fcc98ca4298bb02fc023512ed86.png#pic_center
[321b50b9e3de4216ab280c571e900bfd.png_pic_center]: https://img-blog.csdnimg.cn/321b50b9e3de4216ab280c571e900bfd.png#pic_center
[56884615fd4a43f1aad3ded16dca8e6a.png_pic_center]: https://img-blog.csdnimg.cn/56884615fd4a43f1aad3ded16dca8e6a.png#pic_center
[a6c81f2a6a5a498fb205c87ba3c9634a.png_pic_center]: https://img-blog.csdnimg.cn/a6c81f2a6a5a498fb205c87ba3c9634a.png#pic_center
[81ccd26d8ff442c5aa098cdb342a8fdb.png_pic_center]: https://img-blog.csdnimg.cn/81ccd26d8ff442c5aa098cdb342a8fdb.png#pic_center
[fffb46b26c41461f8d68751e392c5cc1.png_pic_center]: https://img-blog.csdnimg.cn/fffb46b26c41461f8d68751e392c5cc1.png#pic_center
[3fb4a638164549228ec7d1199ac84ebb.png_pic_center]: https://img-blog.csdnimg.cn/3fb4a638164549228ec7d1199ac84ebb.png#pic_center
[c887d030c7b14a51bf914f916242a75c.png_pic_center]: https://img-blog.csdnimg.cn/c887d030c7b14a51bf914f916242a75c.png#pic_center
[d6d381ff211641c19845bed3712e33e3.png_pic_center]: https://img-blog.csdnimg.cn/d6d381ff211641c19845bed3712e33e3.png#pic_center
[98810f74e9584403946080fa69bfa968.png_pic_center]: https://img-blog.csdnimg.cn/98810f74e9584403946080fa69bfa968.png#pic_center
[0816dbd64e68444cbe72b052d391c74e.png_pic_center]: https://img-blog.csdnimg.cn/0816dbd64e68444cbe72b052d391c74e.png#pic_center
[0e4710b33b0f4af5b51a464321dc154d.png_pic_center]: https://img-blog.csdnimg.cn/0e4710b33b0f4af5b51a464321dc154d.png#pic_center
[6ea53801ffb3479ea0141b9ba4b26f5a.png_pic_center]: https://img-blog.csdnimg.cn/6ea53801ffb3479ea0141b9ba4b26f5a.png#pic_center
[3d252353d50c4edc9c0188ab087ffece.png_pic_center]: https://img-blog.csdnimg.cn/3d252353d50c4edc9c0188ab087ffece.png#pic_center
[8fa7620073ef49ffa5cd8b397d4f23bf.png_pic_center]: https://img-blog.csdnimg.cn/8fa7620073ef49ffa5cd8b397d4f23bf.png#pic_center
[2c321b81c55a451e92958eeb9954663a.png_pic_center]: https://img-blog.csdnimg.cn/2c321b81c55a451e92958eeb9954663a.png#pic_center
[5b2ba5c87974417c8a2893db7182c088.png_pic_center]: https://img-blog.csdnimg.cn/5b2ba5c87974417c8a2893db7182c088.png#pic_center
[01dfc7b8d77d491b8320940191b22700.png_pic_center]: https://img-blog.csdnimg.cn/01dfc7b8d77d491b8320940191b22700.png#pic_center
[5d5988ae229b48bf9167e134670f7222.png_pic_center]: https://img-blog.csdnimg.cn/5d5988ae229b48bf9167e134670f7222.png#pic_center
[d7a5c299c4a14fd2a954fa1d31249c20.png_pic_center]: https://img-blog.csdnimg.cn/d7a5c299c4a14fd2a954fa1d31249c20.png#pic_center
[d7a57f53d45f4bed937600f9c03db639.png_pic_center]: https://img-blog.csdnimg.cn/d7a57f53d45f4bed937600f9c03db639.png#pic_center
[f31bc976306442a09fd03833412f2af4.png_pic_center]: https://img-blog.csdnimg.cn/f31bc976306442a09fd03833412f2af4.png#pic_center
[f9780f068c424bf58f4cd8893912ab30.png_pic_center]: https://img-blog.csdnimg.cn/f9780f068c424bf58f4cd8893912ab30.png#pic_center
[10f53198ace8462f80a7afebccfc3a42.png_pic_center]: https://img-blog.csdnimg.cn/10f53198ace8462f80a7afebccfc3a42.png#pic_center
[c0ed62c2d14e4de8a227cec91b0e2f97.png_pic_center]: https://img-blog.csdnimg.cn/c0ed62c2d14e4de8a227cec91b0e2f97.png#pic_center
[6654e2baa85745daa664af202501510d.png_pic_center]: https://img-blog.csdnimg.cn/6654e2baa85745daa664af202501510d.png#pic_center