发表更新fedfab14 分钟读完 (大约2034个字)

fedml-3.Runner源码阅读

wandb 的使用

配置config.yaml

  • enable - true
  • wandb key
  • priject name
    1
    2
    3
    4
    5
    6
    tracking_args:
      log_file_dir: ./log
      enable_wandb: true #enable
      wandb_key: e3be1b9a8ab45f14a6ff454009bc7ca07b8792ba #key
      wandb_project: fedml_mnist_test #project name
      wandb_name: fedml_torch_fedavg_mnist_lr

运行

  • 运行时选择2，将key再输入一次
    1
    2
    3
    4
    5
    6
    7
    wandb: (1) Create a W&B account
    wandb: (2) Use an existing W&B account
    wandb: (3) Dont visualize my results
    wandb: Enter your choice: 2
    wandb: You chose 'Use an existing W&B account'
    wandb: You can find your API key in your browser here: https://wandb.ai/authorize
    wandb: Paste an API key from your profile and hit enter, or press ctrl+c to quit:
阅读更多
发表更新fedfab5 分钟读完 (大约683个字)

fedml-2.Docker多容器配置

Docker安装

1
curl -fsSL https://get.docker.com | bash -s docker --mirror Aliyun
  • 中间遇到输出，提示建议使用for windows
    1
    2
    WSL DETECTED: We recommend using Docker Desktop for Windows.
    Please get Docker Desktop from https://www.docker.com/products/docker-desktop

创建容器并配置环境

验证是否可以使用gpu

  • 官方参考
    1
    docker run --gpus all nvcr.io/nvidia/k8s/cuda-sample:nbody nbody -gpu -benchmark
阅读更多
发表更新fedfab3 分钟读完 (大约460个字)

fabric-9.服务器配置

centos yum错误

1
错误：为 repo 'appstream' 下载元数据失败 : Cannot prepare internal mirrorlist: No URLs in mirrorlist
  • 参考
    1
    2
    sudo sed -i -e "s|mirrorlist=|#mirrorlist=|g" /etc/yum.repos.d/CentOS-*
    sudo sed -i -e "s|#baseurl=http://mirror.centos.org|baseurl=http://vault.centos.org|g" /etc/yum.repos.d/CentOS-*

查看显卡

1
lspci | grep -i vga
  • 没有找到合适的显卡驱动
阅读更多
发表更新fedfab3 分钟读完 (大约387个字)

fabric-5.论文

需要实现

  1. 论文中的新的归一化算法
  2. 防止恶意模型更新
  3. 客户使用私钥签名模型
  4. fedml的节点作为mec服务器起训练作用，再对原始数据进行处理，模拟移动设备对数据添加噪声
  5. 智能合约中记录用户的有效交易，用于用户获取奖励
  6. 如何控制fabric的出块？
  7. 实现IPFS
  8. peer节点和fedml训练节点之间如何获取对方的公钥，如何避免中间人攻击

笔记

IPFS is a peer-to-peer distributed file system that enables distributed computing devices to connect with the same file system.

在IPFS上进行存储，区块链上存储Hash指针，用于找到文件（块大小限制）

在神经网络的中间层添加噪声(ε, δ)-differential，cnn全连接层作为噪声提取器

阅读更多
发表更新fedfab3 分钟读完 (大约502个字)

fabric-4.创建ca

官方教程

创建ca节点

第一次启动CA时，它查找fabric-ca-server-config.yaml文件，其中包含CA配置参数。

编写创建ca的docker-compose文件

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
version: '3.7'

networks:
  fed_fab:
    name: fabric_fedml

services:
  ca_org1:
    image: hyperledger/fabric-ca:latest
    labels:
      service: hyperledger-fabric
    environment:
      - FABRIC_CA_HOME=/etc/hyperledger/fabric-ca-server
      - FABRIC_CA_SERVER_CA_NAME=ca-org1
      - FABRIC_CA_SERVER_TLS_ENABLED=true
      - FABRIC_CA_SERVER_PORT=8050
      - FABRIC_CA_SERVER_OPERATIONS_LISTENADDRESS=0.0.0.0:18050
    ports:
      - "8050:8050"
      - "18050:18050"
    command: sh -c 'fabric-ca-server start -b admin:adminpw -d'
    volumes:
      - ../crypto-config/fabric-ca/org1:/etc/hyperledger/fabric-ca-server
    container_name: ca_org1
    networks:
      - fed_fab

  ca_org2:
    image: hyperledger/fabric-ca:latest
    labels:
      service: hyperledger-fabric
    environment:
      - FABRIC_CA_HOME=/etc/hyperledger/fabric-ca-server
      - FABRIC_CA_SERVER_CA_NAME=ca-org2
      - FABRIC_CA_SERVER_TLS_ENABLED=true
      - FABRIC_CA_SERVER_PORT=9050
      - FABRIC_CA_SERVER_OPERATIONS_LISTENADDRESS=0.0.0.0:19050
    ports:
      - "9050:9050"
      - "19050:19050"
    command: sh -c 'fabric-ca-server start -b admin:adminpw -d'
    volumes:
      - ../crypto-config/fabric-ca/org2:/etc/hyperledger/fabric-ca-server
    container_name: ca_org2
    networks:
      - fed_fab

  ca_orderer:
    image: hyperledger/fabric-ca:latest
    labels:
      service: hyperledger-fabric
    environment:
      - FABRIC_CA_HOME=/etc/hyperledger/fabric-ca-server
      - FABRIC_CA_SERVER_CA_NAME=ca-orderer
      - FABRIC_CA_SERVER_TLS_ENABLED=true
      - FABRIC_CA_SERVER_PORT=7051
      - FABRIC_CA_SERVER_OPERATIONS_LISTENADDRESS=0.0.0.0:17051
    ports:
      - "7051:7051"
      - "17051:17051"
    command: sh -c 'fabric-ca-server start -b admin:adminpw -d'
    volumes:
      - ../crypto-config/fabric-ca/ordererOrg:/etc/hyperledger/fabric-ca-server
    container_name: ca_orderer
    networks:
      - fed_fab
  
  ca_tls:
    image: hyperledger/fabric-ca:latest
    labels:
      service: hyperledger-fabric
    environment:
      - FABRIC_CA_HOME=/etc/hyperledger/fabric-ca-server
      - FABRIC_CA_SERVER_CA_NAME=ca-orderer
      - FABRIC_CA_SERVER_TLS_ENABLED=true
      - FABRIC_CA_SERVER_PORT=7054
      - FABRIC_CA_SERVER_OPERATIONS_LISTENADDRESS=0.0.0.0:17054
    ports:
      - "7054:7054"
      - "17054:17054"
    command: sh -c 'fabric-ca-server start -b admin:adminpw -d'
    volumes:
      - ../crypto-config/fabric-ca/tls-ca:/etc/hyperledger/fabric-ca-server
    container_name: ca_tls
    networks:
      - fed_fab
阅读更多
发表更新fedfab18 分钟读完 (大约2628个字)

fabric-3.链码运行与Api调用

链码的打包

  • 之前已经完成了链码mod的初始化和编译，直接进行打包
    1
    2
    3
    4
    peer lifecycle chaincode package fedfab.tar.gz \
        --path ../../fabric-cluster/chaincode/go/fedfab \
        --label fedfab_1 \
        --lang golang

    在当前目录生成了fedfab.tar.gz文件

将打包好的文件复制到其他cli中

1
2
3
4
docker cp cli0:/opt/gopath/src/github.com/hyperledger/fabric/peer/fedfab.tar.gz ./
docker cp ./fedfab.tar.gz cli1:/opt/gopath/src/github.com/hyperledger/fabric/peer/
docker cp ./fedfab.tar.gz cli2:/opt/gopath/src/github.com/hyperledger/fabric/peer/
docker cp ./fedfab.tar.gz cli3:/opt/gopath/src/github.com/hyperledger/fabric/peer/

链码安装

阅读更多
关注我

链接

分类

最新文章

归档

标签

6.8242
Android1
Android FrameWork1
Android 高级开发瓶颈突破系列课11
Android-官方文档1
Android-官方源码6
Android面试查漏补缺2
C/C++1
Flutter1
Java基础1
Kotlin-Android21
Kotlin-Android 实习25
LeetCode45
LeetCode 1013
LeetCode周赛1
Linux/UNIX系统编程手册38
OI KIWI2
OS4
PAT-(Advanced-Level)-Practice2
PAT-(Basic-Level)-Practice44
blockchain1
fedfab13
gallery1
geth1
git1
gradle1
hexo2
linux2
misc1
projects1
shell2
刷题2
动态规划1
多线程1
排序1
数据库2
牛客2
算法43
×