physics.comp-ph cs.AI cs.LG physics.data-an

Deep Learning Discovers Macroscopic Governing Equations for Viscous Gravity Currents from Microscopic Simulation Data. Although deep learning has been successfully applied in a variety of science and engineering problems owing to its strong high dimensional nonlinear mapping capability, it is of limited use in scientific knowledge discovery. In this work, we propose a deep learning based framework to discover the macroscopic governing equation of viscous gravity current based on high resolution microscopic simulation data without the need for prior knowledge of underlying terms. For two typical scenarios with different viscosity ratios, the deep learning based equations exactly capture the same dominated terms as the theoretically derived equations for describing long term asymptotic behaviors, which validates the proposed framework. Unknown macroscopic equations are then obtained for describing short term behaviors, and additional deep learned compensation terms are eventually discovered. Comparison of posterior tests shows that the deep learning based PDEs actually perform better than the theoretically derived PDEs in predicting evolving viscous gravity currents for both long term and short term regimes. Moreover, the proposed framework is proven to be very robust against non biased data noise for training, which is up to 20 . Consequently, the presented deep learning framework shows considerable potential for discovering unrevealed intrinsic laws in scientific semantic space from raw experimental or simulation results in data space.


Co even domination number of some binary operations on graphs. Let G (V,E) be a simple graph. A dominating set of G is a subset D subseteq V such that every vertex not in D is adjacent to at least one vertex in D . The cardinality of a smallest dominating set of G , denoted by gamma(G) , is the domination number of G . A dominating set D is called co even dominating set if the degree of vertex v is even number for all v in V D . The cardinality of a smallest co even dominating set of G , denoted by gamma coe (G) , is the co even domination number of G . In this paper, we study the co even domination number of some binary operations on graphs.


An Empirical Study of Developers' Discussions about Security Challenges of Different Programming Languages. Given programming languages can provide different types and levels of security support, it is critically important to consider security aspects while selecting programming languages for developing software systems. Inadequate consideration of security in the choice of a programming language may lead to potential ramifications for secure development. Whilst theoretical analysis of the supposed security properties of different programming languages has been conducted, there has been relatively little effort to empirically explore the actual security challenges experienced by developers. We have performed a large scale study of the security challenges of 15 programming languages by quantitatively and qualitatively analysing the developers' discussions from Stack Overflow and GitHub. By leveraging topic modelling, we have derived a taxonomy of 18 major security challenges for 6 topic categories. We have also conducted comparative analysis to understand how the identified challenges vary regarding the different programming languages and data sources. Our findings suggest that the challenges and their characteristics differ substantially for different programming languages and data sources, i.e., Stack Overflow and GitHub. The findings provide evidence based insights and understanding of security challenges related to different programming languages to software professionals (i.e., practitioners or researchers). The reported taxonomy of security challenges can assist both practitioners and researchers in better understanding and traversing the secure development landscape. This study highlights the importance of the choice of technology, e.g., programming language, in secure software engineering. Hence, the findings are expected to motivate practitioners to consider the potential impact of the choice of programming languages on software security.


The Importance of Models in Data Analysis with Small Human Movement Datasets Inspirations from Neurorobotics Applied to Posture Control of Humanoids and Humans. This work presents a system identification procedure based on Convolutional Neural Networks (CNN) for human posture control using the DEC (Disturbance Estimation and Compensation) parametric model. The modular structure of the proposed control model inspired the design of a modular identification procedure, in the sense that the same neural network is used to identify the parameters of the modules controlling different degrees of freedom. In this way the presented examples of body sway induced by external stimuli provide several training samples at once.


A multi schematic classifier independent oversampling approach for imbalanced datasets. Over 85 oversampling algorithms, mostly extensions of the SMOTE algorithm, have been built over the past two decades, to solve the problem of imbalanced datasets. However, it has been evident from previous studies that different oversampling algorithms have different degrees of efficiency with different classifiers. With numerous algorithms available, it is difficult to decide on an oversampling algorithm for a chosen classifier. Here, we overcome this problem with a multi schematic and classifier independent oversampling approach ProWRAS(Proximity Weighted Random Affine Shadowsampling). ProWRAS integrates the Localized Random Affine Shadowsampling (LoRAS)algorithm and the Proximity Weighted Synthetic oversampling (ProWSyn) algorithm. By controlling the variance of the synthetic samples, as well as a proximity weighted clustering system of the minority classdata, the ProWRAS algorithm improves performance, compared to algorithms that generate synthetic samples through modelling high dimensional convex spaces of the minority class. ProWRAS has four oversampling schemes, each of which has its unique way to model the variance of the generated data. Most importantly, the performance of ProWRAS with proper choice of oversampling schemes, is independent of the classifier used. We have benchmarked our newly developed ProWRAS algorithm against five sate of the art oversampling models and four different classifiers on 20 publicly available datasets. ProWRAS outperforms other oversampling algorithms in a statistically significant way, in terms of both F1 score and Kappa score. Moreover, we have introduced a novel measure for classifier independence I score, and showed quantitatively that ProWRAS performs better, independent of the classifier used. In practice, ProWRAS customizes synthetic sample generation according to a classifier of choice and thereby reduces benchmarking efforts.


Integral structures in extended affine Lie algebras. We construct certain integral structures for the cores of reduced tame extended affine Lie algebras of rank at least 2. One of the main tools to achieve this is a generalization of Chevalley automorphisms in the context of extended affine Lie algebras. As an application, groups of extended affine Lie type associated to the adjoint representation are defined over arbitrary fields.


A formal construction of a divergence free basis in the nonconforming virtual element method for the Stokes problem. We develop a formal construction of a pointwise divergence free basis in the nonconforming virtual element method of arbitrary order for the Stokes problem introduced in 19 . The proposed construction can be seen as a generalization of the divergence free basis in Crouzeix Raviart finite element space 10, 17 to the virtual element space. Using the divergence free basis obtained from our construction, we can eliminate the pressure variable from the mixed system and obtain a symmetric positive definite system. Several numerical tests are presented to confirm the efficiency and the accuracy of our construction.


Towards a classification of connected components of the strata of k differentials. A k differential on a Riemann surface is a section of the k th power of the canonical bundle. Loci of k differentials with prescribed number and multiplicities of zeros and poles form a natural stratification for the moduli space of k differentials. The classification of connected components of the strata of k differentials was known for holomorphic differentials, meromorphic differentials and quadratic differentials with at worst simple poles by Kontsevich Zorich, Boissy and Lanneau, respectively. Built on their work we develop new techniques to study connected components of the strata of k differentials for general k . As an application, we give a complete classification of connected components of the strata of quadratic differentials with arbitrary poles. Moreover, we distinguish certain components of the strata of k differentials by generalizing the hyperelliptic structure and spin parity for higher k . We also describe an approach to determine explicitly parities of k differentials in genus zero and one, which inspires an amusing conjecture in number theory. A key viewpoint we use is the notion of multi scale k differentials introduced by Bainbridge Chen Gendron Grushevsky M "oller for k 1 and extended by Costantini M "oller Zachhuber for all k .


A Span Based Model for Joint Overlapped and Discontinuous Named Entity Recognition. Research on overlapped and discontinuous named entity recognition (NER) has received increasing attention. The majority of previous work focuses on either overlapped or discontinuous entities. In this paper, we propose a novel span based model that can recognize both overlapped and discontinuous entities jointly. The model includes two major steps. First, entity fragments are recognized by traversing over all possible text spans, thus, overlapped entities can be recognized. Second, we perform relation classification to judge whether a given pair of entity fragments to be overlapping or succession. In this way, we can recognize not only discontinuous entities, and meanwhile doubly check the overlapped entities. As a whole, our model can be regarded as a relation extraction paradigm essentially. Experimental results on multiple benchmark datasets (i.e., CLEF, GENIA and ACE05) show that our model is highly competitive for overlapped and discontinuous NER.


An Augmented Reality Platform for Introducing Reinforcement Learning to K 12 Students with Robots. Interactive reinforcement learning, where humans actively assist during an agent's learning process, has the promise to alleviate the sample complexity challenges of practical algorithms. However, the inner workings and state of the robot are typically hidden from the teacher when humans provide feedback. To create a common ground between the human and the learning robot, in this paper, we propose an Augmented Reality (AR) system that reveals the hidden state of the learning to the human users. This paper describes our system's design and implementation and concludes with a discussion on two directions for future work which we are pursuing 1) use of our system in AI education activities at the K 12 level and 2) development of a framework for an AR based human in the loop reinforcement learning, where the human teacher can see sensory and cognitive representations of the robot overlaid in the real world.


Well posedness and Continuity Properties of the Degasperis Procesi equation in critical Besov space. In this paper, we obtain the local in time existence and uniqueness of solution to the Degasperis Procesi equation in B 1 infty,1 ( R) . Moreover, we prove that the data to solution of this equation is continuous but not uniformly continuous in B 1 infty,1 .


Broadband ultraviolet visible frequency combs from cascaded high harmonic generation in quasi phase matched waveguides. High harmonic generation (HHG) provides short wavelength light that is useful for precision spectroscopy and probing ultrafast dynamics. We report efficient, phase coherent harmonic generation up to 9th order (333 nm) in chirped periodically poled lithium niobate waveguides driven by phase stable leq 12 nJ, 100 fs pulses at 3 mu m with 100 MHz repetition rate. A mid infrared to ultraviolet visible conversion efficiency as high as 10 is observed, amongst an overall 23 conversion of the fundamental to all harmonics. We verify the coherence of the harmonic frequency combs despite the complex highly nonlinear process. Numerical simulations based on a single broadband envelope equation with quadratic nonlinearity give estimates for the conversion efficiency within approximately 1 order of magnitude over a wide range of experimental parameters. From this comparison we identify a dimensionless parameter capturing the competition between three wave mixing and group velocity walk off of the harmonics that governs the cascaded HHG physics. These results can inform cascaded HHG in a range of different platforms.


Near Optimal Reviewer Splitting in Two Phase Paper Reviewing and Conference Experiment Design. Many scientific conferences employ a two phase paper review process, where some papers are assigned additional reviewers after the initial reviews are submitted. Many conferences also design and run experiments on their paper review process, where some papers are assigned reviewers who provide reviews under an experimental condition. In this paper, we consider the question how should reviewers be divided between phases or conditions in order to maximize total assignment similarity? We make several contributions towards answering this question. First, we prove that when the set of papers requiring additional review is unknown, a simplified variant of this problem is NP hard. Second, we empirically show that across several datasets pertaining to real conference data, dividing reviewers between phases conditions uniformly at random allows an assignment that is nearly as good as the oracle optimal assignment. This uniformly random choice is practical for both the two phase and conference experiment design settings. Third, we provide explanations of this phenomenon by providing theoretical bounds on the suboptimality of this random strategy under certain natural conditions. From these easily interpretable conditions, we provide actionable insights to conference program chairs about whether a random reviewer split is suitable for their conference.


ViDT An Efficient and Effective Fully Transformer based Object Detector. Transformers are transforming the landscape of computer vision, especially for recognition tasks. Detection transformers are the first fully end to end learning systems for object detection, while vision transformers are the first fully transformer based architecture for image classification. In this paper, we integrate Vision and Detection Transformers (ViDT) to build an effective and efficient object detector. ViDT introduces a reconfigured attention module to extend the recent Swin Transformer to be a standalone object detector, followed by a computationally efficient transformer decoder that exploits multi scale features and auxiliary techniques essential to boost the detection performance without much increase in computational load. Extensive evaluation results on the Microsoft COCO benchmark dataset demonstrate that ViDT obtains the best AP and latency trade off among existing fully transformer based object detectors, and achieves 49.2AP owing to its high scalability for large models. We will release the code and trained models at https github.com naver ai vidt


Revisiting the Primacy of English in Zero shot Cross lingual Transfer. Despite their success, large pre trained multilingual models have not completely alleviated the need for labeled data, which is cumbersome to collect for all target languages. Zero shot cross lingual transfer is emerging as a practical solution pre trained models later fine tuned on one transfer language exhibit surprising performance when tested on many target languages. English is the dominant source language for transfer, as reinforced by popular zero shot benchmarks. However, this default choice has not been systematically vetted. In our study, we compare English against other transfer languages for fine tuning, on two pre trained multilingual models (mBERT and mT5) and multiple classification and question answering tasks. We find that other high resource languages such as German and Russian often transfer more effectively, especially when the set of target languages is diverse or unknown a priori. Unexpectedly, this can be true even when the training sets were automatically translated from English. This finding can have immediate impact on multilingual zero shot systems, and should inform future benchmark designs.


Beep And Sleep Message and Energy Efficient Set Cover. We observe message efficient distributed algorithms for the Set Cover problem. Given a ground set U of n elements and m subsets of U , we aim to find the minimal number of these subsets that contain all elements. In the default distributed setup of this problem, each set has a bidirected communication link with each element it contains. Our first result is a tilde O ( log 2( Delta)) time and O( sqrt Delta) (n m)) message algorithm with expected approximation ration of O( log( Delta)) in the KT 0 model. The value Delta denotes the maximal cardinality of each subset. Our algorithm is emph almost optimal with regard to time and message complexity. Further, we present Set Cover algorithm in the Beeping model that only relies on carrier sensing and can trade runtime for approximation ratio similar to the celebrated algorithm by Kuhn and Wattenhofer PODC '03 .


The physical basis of the zero charge flux constraint in gyro kinetics as local momentum conservation, by analogy to the classical Coulomb collisional case. Gyrokinetic turbulence is subject to the constraint that the turbulent charge flux vanishes. This is interpreted, in detail, as arising from momentum conservation at the fluctuation scale. There are beautiful and deep analogies with the classical transport from Coulomb collisions.


A nutritional strategy to promote gilthead seabream performance under low temperatures. Gilthead seabream (Sparus aurata) is vulnerable to low water temperature, which may occur in the Southern Europe and Mediterranean region during Winter. Fish are poikilothermic animals, so feed intake, digestion, metabolism and ultimately growth are affected by water temperature. This study aimed to evaluate growth performance, feed utilisation, nutrient apparent digestibility, and N losses to the environment in seabream juveniles reared under low temperature (13 degrees Celsius). Three isolipid and isoenergetic diets were formulated a commercial like diet (COM) with 44 crude protein and 27.5 fishmeal and 2 diets with 42 CP (ECO and ECOSup), reduced FM inclusion, and 15 poultry meal. ECOSup diet was supplemented with a mix of feed additives intended to promote fish growth and feed intake. The ECO diets presented lower production costs than the COM diet and included more sustainable ingredients. Seabream juveniles (154.5 g) were randomly assigned to triplicate tanks and fed the diets for 84 days. Fish fed the ECOSup and COM diets attained a similar final body weight. ECOSup fed fish presented significantly higher HSI than COM fed fish, probably due to higher hepatic glycogen reserves. The VSI of ECOSup fed fish were significantly lower compared to COM fed fish, which is a positive achievement from a consumer point of view. Nutrient digestibility was similar in ECOSup and COM diets. Feeding fish with the ECO diets resulted in lower faecal N losses when compared to COM fed fish. Feeding seabream with an eco friendly diet with a mix of feed additives promoted growth, improved fish nutritional status and minimised N losses to the environment whilst lowering production costs. Nutritional strategies that ultimately promote feed intake and diet utilisation are valuable tools that may help conditioning fish to sustain growth even under adverse conditions.


Robust pedestrian detection in thermal imagery using synthesized images. In this paper we propose a method for improving pedestrian detection in the thermal domain using two stages first, a generative data augmentation approach is used, then a domain adaptation method using generated data adapts an RGB pedestrian detector. Our model, based on the Least Squares Generative Adversarial Network, is trained to synthesize realistic thermal versions of input RGB images which are then used to augment the limited amount of labeled thermal pedestrian images available for training. We apply our generative data augmentation strategy in order to adapt a pretrained YOLOv3 pedestrian detector to detection in the thermal only domain. Experimental results demonstrate the effectiveness of our approach using less than 50 of available real thermal training data, and relying on synthesized data generated by our model in the domain adaptation phase, our detector achieves state of the art results on the KAIST Multispectral Pedestrian Detection Benchmark even if more real thermal data is available adding GAN generated images to the training data results in improved performance, thus showing that these images act as an effective form of data augmentation. To the best of our knowledge, our detector achieves the best single modality detection results on KAIST with respect to the state of the art.


Attribute reduction and rule acquisition of formal decision context based on two new kinds of decision rules. This paper mainly studies the rule acquisition and attribute reduction for formal decision context based on two new kinds of decision rules, namely I decision rules and II decision rules. The premises of these rules are object oriented concepts, and the conclusions are formal concept and property oriented concept respectively. The rule acquisition algorithms for I decision rules and II decision rules are presented. Some comparative analysis of these algorithms with the existing algorithms are examined which shows that the algorithms presented in this study behave well. The attribute reduction approaches to preserve I decision rules and II decision rules are presented by using discernibility matrix.


Shear flows and their suppression at large aspect ratio. Two dimensional simulations of a growing convection zone. We investigate the onset and evolution of zonal flows in a growing convective layer when a stably stratified fluid with a composition gradient is cooled from above. This configuration allows the study of zonal flows for a wide range of values of the Rayleigh number, Ra , and aspect ratio of the convection zone within a given simulation. We perform a series of 2D simulations using the Boussinesq approximation, with aspect ratio of the computational domain between 1 and 5 , and Prandtl number Pr 0.1 , 0.5, 1, and 7 . We find that for square domains zonal flows appear when the aspect ratio of the convective layer is smaller than two, and the evolution of the system depends on the Prandtl number. For Pr leq 1 , the fluid experiences bursts of convective transport with negligible convective transport between bursts. The magnitude and frequency of the bursts are smaller at low Pr , which suggests that the bursting regime is stronger in a narrow range around Pr 1 , as observed in previous studies of thermal convection. For Pr 7 , the structure of the flow consists of tilted convective plumes, and the convective transport is sustained at all times. In wider domains, the aspect ratio of the convective zone is always much larger than two and zonal flows do not appear. These results confirm and extend to fluids with stable composition gradients previous findings on thermal convection. The fact that zonal flows can be avoided by using computational domains with large aspect ratios opens up the possibility of 2D studies of convective overshoot, layer formation and transport properties across diffusive interfaces.


Families of functionals representing Sobolev norms. We obtain new characterizations of the Sobolev spaces dot W 1,p ( mathbb R N) and the bounded variation space dot BV ( mathbb R N) . The characterizations are in terms of the functionals nu gamma (E lambda, gamma p u ) where E lambda, gamma p u Big (x,y ) in mathbb R N times mathbb R N colon x neq y, , frac u(x) u(y) x y 1 gamma p lambda Big and the measure nu gamma is given by mathrm d nu gamma(x,y) x y gamma N mathrm d x mathrm d y . We provide characterizations which involve the L p, infty quasi norms sup lambda 0 lambda , nu gamma (E lambda, gamma p u ) 1 p and also exact formulas via corresponding limit functionals, with the limit for lambda to infty when gamma 0 and the limit for lambda to 0 when gamma 0 . The results unify and substantially extend previous work by Nguyen and by Brezis, Van Schaftingen and Yung. For p 1 the characterizations hold for all gamma neq 0 . For p 1 the upper bounds for the L 1, infty quasi norms fail in the range gamma in 1,0) moreover in this case the limit functionals represent the L 1 norm of the gradient for C infty c functions but not for generic dot W 1,1 functions. For this situation we provide new counterexamples which are built on self similar sets of dimension gamma 1 . For gamma 0 the characterizations of Sobolev spaces fail however we obtain a new formula for the Lipschitz norm via the expressions nu 0(E lambda,0 u ) .


Preserving Diversity when Partitioning A Geometric Approach. Diversity plays a crucial role in multiple contexts such as team formation, representation of minority groups and generally when allocating resources fairly. Given a community composed by individuals of different types, we study the problem of partitioning this community such that the global diversity is preserved as much as possible in each subgroup. We consider the diversity metric introduced by Simpson in his influential work that, roughly speaking, corresponds to the inverse probability that two individuals are from the same type when taken uniformly at random, with replacement, from the community of interest. We provide a novel perspective by reinterpreting this quantity in geometric terms. We characterize the instances in which the optimal partition exactly preserves the global diversity in each subgroup. When this is not possible, we provide an efficient polynomial time algorithm that outputs an optimal partition for the problem with two types. Finally, we discuss further challenges and open questions for the problem that considers more than two types.


CNN Cap Effective Convolutional Neural Network Based Capacitance Models for Full Chip Parasitic Extraction. Accurate capacitance extraction is becoming more important for designing integrated circuits under advanced process technology. The pattern matching based full chip extraction methodology delivers fast computational speed, but suffers from large error, and tedious efforts on building capacitance models of the increasing structure patterns. In this work, we propose an effective method for building convolutional neural network (CNN) based capacitance models (called CNN Cap) for two dimensional (2 D) structures in full chip capacitance extraction. With a novel grid based data representation, the proposed method is able to model the pattern with a variable number of conductors, so that largely reduce the number of patterns. Based on the ability of ResNet architecture on capturing spatial information and the proposed training skills, the obtained CNN Cap exhibits much better performance over the multilayer perception neural network based capacitance model while being more versatile. Extensive experiments on a 55nm and a 15nm process technologies have demonstrated that the error of total capacitance produced with CNN Cap is always within 1.3 and the error of produced coupling capacitance is less than 10 in over 99.5 probability. CNN Cap runs more than 4000X faster than 2 D field solver on a GPU server, while it consumes negligible memory compared to the look up table based capacitance model.


Traffic Net 3D Traffic Monitoring Using a Single Camera. Computer Vision has played a major role in Intelligent Transportation Systems (ITS) and traffic surveillance. Along with the rapidly growing automated vehicles and crowded cities, the automated and advanced traffic management systems (ATMS) using video surveillance infrastructures have been evolved by the implementation of Deep Neural Networks. In this research, we provide a practical platform for real time traffic monitoring, including 3D vehicle pedestrian detection, speed detection, trajectory estimation, congestion detection, as well as monitoring the interaction of vehicles and pedestrians, all using a single CCTV traffic camera. We adapt a custom YOLOv5 deep neural network model for vehicle pedestrian detection and an enhanced SORT tracking algorithm. For the first time, a hybrid satellite ground based inverse perspective mapping (SG IPM) method for camera auto calibration is also developed which leads to an accurate 3D object detection and visualisation. We also develop a hierarchical traffic modelling solution based on short and long term temporal video data stream to understand the traffic flow, bottlenecks, and risky spots for vulnerable road users. Several experiments on real world scenarios and comparisons with state of the art are conducted using various traffic monitoring datasets, including MIO TCD, UA DETRAC and GRAM RTM collected from highways, intersections, and urban areas under different lighting and weather conditions.


Camouflaged Instance Segmentation In The Wild Dataset, Method, and Benchmark Suite. This paper pushes the envelope on decomposing camouflaged regions in an image into meaningful components, namely, camouflaged instances. To promote the new task of camouflaged instance segmentation of in the wild images, we introduce a dataset, dubbed CAMO , that extends our preliminary CAMO dataset (camouflaged object segmentation) in terms of quantity and diversity. The new dataset substantially increases the number of images with hierarchical pixel wise ground truths. We also provide a benchmark suite for the task of camouflaged instance segmentation. In particular, we present an extensive evaluation of state of the art instance segmentation methods on our newly constructed CAMO dataset in various scenarios. We also present a camouflage fusion learning (CFL) framework for camouflaged instance segmentation to further improve the performance of state of the art methods. The dataset, model, evaluation suite, and benchmark will be made publicly available on our project page https sites.google.com view ltnghia research camo plus plus


SoGCN Second Order Graph Convolutional Networks. Graph Convolutional Networks (GCN) with multi hop aggregation is more expressive than one hop GCN but suffers from higher model complexity. Finding the shortest aggregation range that achieves comparable expressiveness and minimizes this side effect remains an open question. We answer this question by showing that multi layer second order graph convolution (SoGC) is sufficient to attain the ability of expressing polynomial spectral filters with arbitrary coefficients. Compared to models with one hop aggregation, multi hop propagation, and jump connections, SoGC possesses filter representational completeness while being lightweight, efficient, and easy to implement. Thereby, we suggest that SoGC is a simple design capable of forming the basic building block of GCNs, playing the same role as 3 times 3 kernels in CNNs. We build our Second Order Graph Convolutional Networks (SoGCN) with SoGC and design a synthetic dataset to verify its filter fitting capability to validate these points. For real world tasks, we present the state of the art performance of SoGCN on the benchmark of node classification, graph classification, and graph regression datasets.


Sparse Sampling Kaczmarz Motzkin Method with Linear Convergence. The randomized sparse Kaczmarz method was recently proposed to recover sparse solutions of linear systems. In this work, we introduce a greedy variant of the randomized sparse Kaczmarz method by employing the sampling Kaczmarz Motzkin method, and prove its linear convergence in expectation with respect to the Bregman distance in the noiseless and noisy cases. This greedy variant can be viewed as a unification of the sampling Kaczmarz Motzkin method and the randomized sparse Kaczmarz method, and hence inherits the merits of these two methods. Numerically, we report a couple of experimental results to demonstrate its superiority


Computational Complexity of Deciding Provability in Linear Logic and its Fragments. Linear logic was conceived in 1987 by Girard and, in contrast to classical logic, restricts the usage of the structural inference rules of weakening and contraction. With this, atoms of the logic are no longer interpreted as truth, but as information or resources. This interpretation makes linear logic a useful tool for formalisation in mathematics and computer science. Linear logic has, for example, found applications in proof theory, quantum logic, and the theory of programming languages. A central problem of the logic is the question whether a given list of formulas is provable with the calculus. In the research regarding the complexity of this problem, some results were achieved, but other questions are still open. To present these questions and give new perspectives, this thesis consists of three main parts which build on each other We present the syntax, proof theory, and various approaches to a semantics for linear logic. Here already, we will meet some open research questions. We present the current state of the complexity theoretic characterization of the most important fragments of linear logic. Here, further research problems are presented and it becomes apparent that until now, the results have all made use of different approaches. We prove an original complexity characterization of a fragment of the logic and present ideas for a new, structural approach to the examination of provability in linear logic.


The Clebsch Gordan rule and the Hamming graphs. Let D geq 1 and q geq 3 be two integers. Let H(D) H(D,q) denote the D dimensional Hamming graph over a q element set. Let mathcal T(D) denote the Terwilliger algebra of H(D) . In this paper we apply the Clebsch Gordan rule for U( mathfrak sl 2) to decompose the standard mathcal T(D) module into the direct sum of irreducible mathcal T(D) modules.


Cross view Geo localization with Evolving Transformer. In this work, we address the problem of cross view geo localization, which estimates the geospatial location of a street view image by matching it with a database of geo tagged aerial images. The cross view matching task is extremely challenging due to drastic appearance and geometry differences across views. Unlike existing methods that predominantly fall back on CNN, here we devise a novel evolving geo localization Transformer (EgoTR) that utilizes the properties of self attention in Transformer to model global dependencies, thus significantly decreasing visual ambiguities in cross view geo localization. We also exploit the positional encoding of Transformer to help the EgoTR understand and correspond geometric configurations between ground and aerial images. Compared to state of the art methods that impose strong assumption on geometry knowledge, the EgoTR flexibly learns the positional embeddings through the training objective and hence becomes more practical in many real world scenarios. Although Transformer is well suited to our task, its vanilla self attention mechanism independently interacts within image patches in each layer, which overlooks correlations between layers. Instead, this paper propose a simple yet effective self cross attention mechanism to improve the quality of learned representations. The self cross attention models global dependencies between adjacent layers, which relates between image patches while modeling how features evolve in the previous layer. As a result, the proposed self cross attention leads to more stable training, improves the generalization ability and encourages representations to keep evolving as the network goes deeper. Extensive experiments demonstrate that our EgoTR performs favorably against state of the art methods on standard, fine grained and cross dataset cross view geo localization tasks.


On the Convergence and Robustness of Adversarial Training. Improving the robustness of deep neural networks (DNNs) to adversarial examples is an important yet challenging problem for secure deep learning. Across existing defense techniques, adversarial training with Projected Gradient Decent (PGD) is amongst the most effective. Adversarial training solves a min max optimization problem, with the textit inner maximization generating adversarial examples by maximizing the classification loss, and the textit outer minimization finding model parameters by minimizing the loss on adversarial examples generated from the inner maximization. A criterion that measures how well the inner maximization is solved is therefore crucial for adversarial training. In this paper, we propose such a criterion, namely First Order Stationary Condition for constrained optimization (FOSC), to quantitatively evaluate the convergence quality of adversarial examples found in the inner maximization. With FOSC, we find that to ensure better robustness, it is essential to use adversarial examples with better convergence quality at the textit later stages of training. Yet at the early stages, high convergence quality adversarial examples are not necessary and may even lead to poor robustness. Based on these observations, we propose a textit dynamic training strategy to gradually increase the convergence quality of the generated adversarial examples, which significantly improves the robustness of adversarial training. Our theoretical and empirical results show the effectiveness of the proposed method.


iFlow Numerically Invertible Flows for Efficient Lossless Compression via a Uniform Coder. It was estimated that the world produced 59 ZB ( 5.9 times 10 13 GB ) of data in 2020, resulting in the enormous costs of both data storage and transmission. Fortunately, recent advances in deep generative models have spearheaded a new class of so called "neural compression" algorithms, which significantly outperform traditional codecs in terms of compression ratio. Unfortunately, the application of neural compression garners little commercial interest due to its limited bandwidth therefore, developing highly efficient frameworks is of critical practical importance. In this paper, we discuss lossless compression using normalizing flows which have demonstrated a great capacity for achieving high compression ratios. As such, we introduce iFlow, a new method for achieving efficient lossless compression. We first propose Modular Scale Transform (MST) and a novel family of numerically invertible flow transformations based on MST. Then we introduce the Uniform Base Conversion System (UBCS), a fast uniform distribution codec incorporated into iFlow, enabling efficient compression. iFlow achieves state of the art compression ratios and is 5 times quicker than other high performance schemes. Furthermore, the techniques presented in this paper can be used to accelerate coding time for a broad class of flow based algorithms.


Leveraging Transprecision Computing for Machine Vision Applications at the Edge. Machine vision tasks present challenges for resource constrained edge devices, particularly as they execute multiple tasks with variable workloads. A robust approach that can dynamically adapt in runtime while maintaining the maximum quality of service (QoS) within resource constraints, is needed. The paper presents a lightweight approach that monitors the runtime workload constraint and leverages accuracy throughput trade off. Optimisation techniques are included which find the configurations for each task for optimal accuracy, energy and memory and manages transparent switching between configurations. For an accuracy drop of 1 , we show a 1.6x higher achieved frame processing rate with further improvements possible at lower accuracy.


Deadlock Free Session Types in Linear Haskell. Priority Sesh is a library for session typed communication in Linear Haskell which offers strong compile time correctness guarantees. Priority Sesh offers two deadlock free APIs for session typed communication. The first guarantees deadlock freedom by restricting the process structure to trees and forests. It is simple and composeable, but rules out cyclic structures. The second guarantees deadlock freedom via priorities, which allows the programmer to safely use cyclic structures as well. Our library relies on Linear Haskell to guarantee linearity, which leads to easy to write session types and highly idiomatic code, and lets us avoid the complex encodings of linearity in the Haskell type system that made previous libraries difficult to use.


Quality Estimation without Human labeled Data. Quality estimation aims to measure the quality of translated content without access to a reference translation. This is crucial for machine translation systems in real world scenarios where high quality translation is needed. While many approaches exist for quality estimation, they are based on supervised machine learning requiring costly human labelled data. As an alternative, we propose a technique that does not rely on examples from human annotators and instead uses synthetic training data. We train off the shelf architectures for supervised quality estimation on our synthetic data and show that the resulting models achieve comparable performance to models trained on human annotated data, both for sentence and word level prediction.


Energy and Thermal aware Resource Management of Cloud Data Centres A Taxonomy and Future Directions. This paper investigates the existing resource management approaches in Cloud Data Centres for energy and thermal efficiency. It identifies the need for integrated computing and cooling systems management and learning based solutions in resource management systems. A taxonomy on energy and thermal efficient resource management in data centres is proposed based on an in depth analysis of the literature. Furthermore, a detailed survey on existing approaches is conducted according to the taxonomy and recent advancements including machine learning based resource management approaches and cooling management technologies are discussed.


Embedding Node Structural Role Identity Using Stress Majorization. Nodes in networks may have one or more functions that determine their role in the system. As opposed to local proximity, which captures the local context of nodes, the role identity captures the functional "role" that nodes play in a network, such as being the center of a group, or the bridge between two groups. This means that nodes far apart in a network can have similar structural role identities. Several recent works have explored methods for embedding the roles of nodes in networks. However, these methods all rely on either approximating or indirect modeling of structural equivalence. In this paper, we present a novel and flexible framework using stress majorization, to transform the high dimensional role identities in networks directly (without approximation or indirect modeling) to a low dimensional embedding space. Our method is also flexible, in that it does not rely on specific structural similarity definitions. We evaluated our method on the tasks of node classification, clustering, and visualization, using three real world and five synthetic networks. Our experiments show that our framework achieves superior results than existing methods in learning node role representations.


The Impact of Spatiotemporal Augmentations on Self Supervised Audiovisual Representation Learning. Contrastive learning of auditory and visual perception has been extremely successful when investigated individually. However, there are still major questions on how we could integrate principles learned from both domains to attain effective audiovisual representations. In this paper, we present a contrastive framework to learn audiovisual representations from unlabeled videos. The type and strength of augmentations utilized during self supervised pre training play a crucial role for contrastive frameworks to work sufficiently. Hence, we extensively investigate composition of temporal augmentations suitable for learning audiovisual representations we find lossy spatio temporal transformations that do not corrupt the temporal coherency of videos are the most effective. Furthermore, we show that the effectiveness of these transformations scales with higher temporal resolution and stronger transformation intensity. Compared to self supervised models pre trained on only sampling based temporal augmentation, self supervised models pre trained with our temporal augmentations lead to approximately 6.5 gain on linear classifier performance on AVE dataset. Lastly, we show that despite their simplicity, our proposed transformations work well across self supervised learning frameworks (SimSiam, MoCoV3, etc), and benchmark audiovisual dataset (AVE).


Asymptotic Convergence for a Class of Fully Nonlinear Contracting Curvature Flows. In this paper, we study a class of fully nonlinear contracting curvature flows of closed, uniformly convex hypersurfaces in the Euclidean space mathbb R n 1 with the normal speed Phi given by r alpha F beta or u alpha F beta , where F is a monotone, symmetric, inverse concave, homogeneous of degree one function of the principal curvatures, r is the distance from the hypersurface to the origin and u is the support function of hypersurface. If alpha geq beta 1 when Phi r alpha F beta or alpha beta 1 when Phi u alpha F beta , we prove that the flow exists for all times and converges to the origin. After proper rescaling, we prove that the normalized flow converges exponentially in the C infty topology to a sphere centered at the origin. Furthermore, for special inverse concave curvature function F K frac s n F 1 1 s (s in(0, 1 ) , where K is Gauss curvature and F 1 is inverse concave, we obtain the asymptotic convergence for the flow with Phi u alpha F beta when alpha beta 1 . If alpha beta 1 , a counterexample is given for the above convergence when speed equals to r alpha F beta .


PG 2 Net Personalized and Group Preferences Guided Network for Next Place Prediction. Predicting the next place to visit is a key in human mobility behavior modeling, which plays a significant role in various fields, such as epidemic control, urban planning, traffic management, and travel recommendation. To achieve this, one typical solution is designing modules based on RNN to capture their preferences to various locations. Although these RNN based methods can effectively learn individual's hidden personalized preferences to her visited places, the interactions among users can only be weakly learned through the representations of locations. Targeting this, we propose an end to end framework named personalized and group preference guided network (PG 2 Net), considering the users' preferences to various places at both individual and collective levels. Specifically, PG 2 Net concatenates Bi LSTM and attention mechanism to capture each user's long term mobility tendency. To learn population's group preferences, we utilize spatial and temporal information of the visitations to construct a spatio temporal dependency module. We adopt a graph embedding method to map users' trajectory into a hidden space, capturing their sequential relation. In addition, we devise an auxiliary loss to learn the vectorial representation of her next location. Experiment results on two Foursquare check in datasets and one mobile phone dataset indicate the advantages of our model compared to the state of the art baselines. Source codes are available at https github.com urbanmobility PG2Net.


Uncoordinated Spectrum Sharing in Millimeter Wave Networks Using Carrier Sensing. We propose using Carrier Sensing (CS) for distributed interference management in millimeter wave (mmWave) cellular networks where spectrum is shared by multiple operators that do not coordinate among themselves. In addition, even the base station sites can be shared by the operators. We describe important challenges in using traditional CS in this setting and propose enhanced CS protocols to address these challenges. Using stochastic geometry, we develop a general framework for downlink coverage probability analysis of our shared mmWave network in the presence of CS and derive the downlink coverage probability expressions for several CS protocols. To the best of our knowledge, our work is the first to investigate and analyze (using stochastic geometry) CS for mmWave networks with spectrum and BS sites shared among non coordinating operators. We evaluate the downlink coverage probability of our shared mmWave network using simulations as well as numerical examples based on our analysis. Our evaluations show that our proposed enhancements lead to an improvement in downlink coverage probability, compared to the downlink coverage probability with no CS, for higher values of signal to interference and noise ratio (SINR). Interestingly, our evaluations also reveal that for lower values of SINR, not using any CS is the best strategy in terms of the downlink coverage probability.


The Artificial Scientist Logicist, Emergentist, and Universalist Approaches to Artificial General Intelligence. We attempt to define what is necessary to construct an Artificial Scientist, explore and evaluate several approaches to artificial general intelligence (AGI) which may facilitate this, conclude that a unified or hybrid approach is necessary and explore two theories that satisfy this requirement to some degree.


A conjecture of Zagier and the value distribution of quantum modular forms. In his influential paper on quantum modular forms, Zagier developed a conjectural framework describing the behavior of certain quantum knot invariants under the action of the modular group on their argument. More precisely, when J K,0 denotes the colored Jones polynomial of a knot K , Zagier's modularity conjecture describes the asymptotics of the quotient J K,0 (e 2 pi i gamma(x) ) J K,0 (e 2 pi i x ) as x to infty along rationals with bounded denominators, where gamma in mathrm SL (2, mathbb Z ) . This problem is most accessible for the figure eight knot 4 1 , when the colored Jones polynomial has an explicit expression in terms of the q Pochhammer symbol. Zagier also conjectured that the function h(x) log (J 4 1,0 (e 2 pi i x ) J 4 1,0 (e 2 pi i x )) can be extended to a function on mathbb R which is continuous at irrationals. In the present paper, we prove Zagier's continuity conjecture for all irrationals which have unbounded partial quotients in their continued fraction expansion. In particular, the continuity conjecture holds almost everywhere on the real line. We also establish a smooth approximation of h , uniform over all rationals, in accordance with the modularity conjecture. As an application, we find the limit distribution (after a suitable centering and rescaling) of log (J 4 1,0 (e 2 pi i x )) , when x ranges over all reduced rationals in (0,1) with denominator at most N , as N to infty , thereby confirming a conjecture of Bettin and Drappeau.


A survey of deep neural network watermarking techniques. Protecting the Intellectual Property Rights (IPR) associated to Deep Neural Networks (DNNs) is a pressing need pushed by the high costs required to train such networks and the importance that DNNs are gaining in our society. Following its use for Multimedia (MM) IPR protection, digital watermarking has recently been considered as a mean to protect the IPR of DNNs. While DNN watermarking inherits some basic concepts and methods from MM watermarking, there are significant differences between the two application areas, calling for the adaptation of media watermarking techniques to the DNN scenario and the development of completely new methods. In this paper, we overview the most recent advances in DNN watermarking, by paying attention to cast it into the bulk of watermarking theory developed during the last two decades, while at the same time highlighting the new challenges and opportunities characterizing DNN watermarking. Rather than trying to present a comprehensive description of all the methods proposed so far, we introduce a new taxonomy of DNN watermarking and present a few exemplary methods belonging to each class. We hope that this paper will inspire new research in this exciting area and will help researchers to focus on the most innovative and challenging problems in the field.


Maximum Matching sans Maximal Matching A New Approach for Finding Maximum Matchings in the Data Stream Model. The problem of finding a maximum size matching in a graph (known as the maximum matching problem) is one of the most classical problems in computer science. Despite a significant body of work dedicated to the study of this problem in the data stream model, the state of the art single pass semi streaming algorithm for it is still a simple greedy algorithm that computes a maximal matching, and this way obtains 1 2 approximation. Some previous works described two three pass algorithms that improve over this approximation ratio by using their second and third passes to improve the above mentioned maximal matching. One contribution of this paper continuous this line of work by presenting new three pass semi streaming algorithms that work along these lines and obtain improved approximation ratios of 0.6111 and 0.5694 for triangle free and general graphs, respectively. Unfortunately, a recent work (Konrad and Naidu, 2021) shows that the strategy of constructing a maximal matching in the first pass and then improving it in further passes has limitations. Additionally, this technique is unlikely to get us closer to single pass semi streaming algorithms obtaining a better than 1 2 approximation. Therefore, it is interesting to come up with algorithms that do something else with their first pass (we term such algorithms non maximal matching first algorithms). No such algorithms are currently known (to the best of our knowledge), and the main contribution of this paper is describing such algorithms that obtain approximation ratios of 0.5384 and 0.5555 in two and three passes, respectively, for general graphs (the result for three passes improves over the previous state of the art, but is worse than the result of this paper mentioned in the previous paragraph for general graphs).


The Hardest Explicit Construction. We investigate the complexity of explicit construction problems, where the goal is to produce a particular object of size n possessing some pseudorandom property in time polynomial in n . We give overwhelming evidence that bf APEPP , defined originally by Kleinberg et al., is the natural complexity class associated with explicit constructions of objects whose existence follows from the probabilistic method, by placing a variety of such construction problems in this class. We then demonstrate that a result of Je v r ' a bek on provability in Bounded Arithmetic, when reinterpreted as a reduction between search problems, shows that constructing a truth table of high circuit complexity is complete for bf APEPP under bf P bf NP reductions. This illustrates that Shannon's classical proof of the existence of hard boolean functions is in fact a textit universal probabilistic existence argument derandomizing his proof implies a generic derandomization of the probabilistic method. As a corollary, we prove that bf EXP bf NP contains a language of circuit complexity 2 n Omega(1) if and only if it contains a language of circuit complexity frac 2 n 2n . Finally, for several of the problems shown to lie in bf APEPP , we demonstrate direct polynomial time reductions to the explicit construction of hard truth tables.


An L 2 Analysis of Reinforcement Learning in High Dimensions with Kernel and Neural Network Approximation. Reinforcement learning (RL) algorithms based on high dimensional function approximation have achieved tremendous empirical success in large scale problems with an enormous number of states. However, most analysis of such algorithms gives rise to error bounds that involve either the number of states or the number of features. This paper considers the situation where the function approximation is made either using the kernel method or the two layer neural network model, in the context of a fitted Q iteration algorithm with explicit regularization. We establish an tilde O (H 3 mathcal A frac14 n frac14 ) bound for the optimal policy with Hn samples, where H is the length of each episode and mathcal A is the size of action space. Our analysis hinges on analyzing the L 2 error of the approximated Q function using n data points. Even though this result still requires a finite sized action space, the error bound is independent of the dimensionality of the state space.


A comparison of two approaches for measuring interdisciplinary research output the disciplinary diversity of authors vs the disciplinary diversity of the reference list. This study investigates the convergence of two bibliometric approaches to the measurement of interdisciplinary research one based on analyzing disciplinary diversity in the reference list of publications, the other based on the disciplinary diversity of authors of publications. In particular we measure the variety, balance, disparity and integrated diversity index of, respectively, single author, multi author single field, and multi author multi field publications. We find that, in general, the diversity of the reference list grows with the number of fields reflected in a paper's authors' list and, to a lesser extent, with the number of authors being equal the number of fields. Further, we find that when fields belonging to different disciplines are reflected in the authors' list, the disparity in the reference list is higher than in the case of fields belonging to the same discipline. However, this general tendency varies across disciplines, and noticeable exceptions are found at individual paper level.


Data Augmentation for Voice Assistant NLU using BERT based Interchangeable Rephrase. We introduce a data augmentation technique based on byte pair encoding and a BERT like self attention model to boost performance on spoken language understanding tasks. We compare and evaluate this method with a range of augmentation techniques encompassing generative models such as VAEs and performance boosting techniques such as synonym replacement and back translation. We show our method performs strongly on domain and intent classification tasks for a voice assistant and in a user study focused on utterance naturalness and semantic similarity.


Polarization independent isotropic nonlocal metasurfaces with wavelength controlled functionality. Flat optics has demonstrated great advances in miniaturizing conventional, bulky optical elements due to the recent developments in metasurface design. Specific applications of such designs include spatial differentiation and the compression of free space. However, metasurfaces designed for such applications are often polarization dependent and are designed for a single functionality. In this work, we introduce a polarization independent metasurface structure by designing guided resonances with degenerate band curvatures in a photonic crystal slab. Our device can perform both free space compression and spatial differentiation when operated at different frequencies at normal incidence. This work demonstrates the promise of dispersion engineering in metasurface design to create ultrathin devices with polarization independent functionality.


High performance lasers for fully integrated silicon nitride photonics. Silicon nitride (SiN) waveguides with ultra low optical loss enable integrated photonic applications including low noise, narrow linewidth lasers, chip scale nonlinear photonics, and microwave photonics. Lasers are key components to SiN photonic integrated circuits (PICs), but are difficult to fully integrate with low index SiN waveguides due to their large mismatch with the high index III V gain materials. The recent demonstration of multilayer heterogeneous integration provides a practical solution and enabled the first generation of lasers fully integrated with SiN waveguides. However a laser with high device yield and high output power at telecommunication wavelengths, where photonics applications are clustered, is still missing, hindered by large mode transition loss, nonoptimized cavity design, and a complicated fabrication process. Here, we report high performance lasers on SiN with tens of milliwatts output through the SiN waveguide and sub kHz fundamental linewidth, addressing all of the aforementioned issues. We also show Hertz level linewidth lasers are achievable with the developed integration techniques. These lasers, together with high Q SiN resonators, mark a milestone towards a fully integrated low noise silicon nitride photonics platform. This laser should find potential applications in LIDAR, microwave photonics and coherent optical communications.


On the interplay of anisotropy and geometry for polycrystals in single slip crystal plasticity. In this paper, we investigate a variational polycrystalline model in finite crystal plasticity with one active slip system and rigid elasticity. The task is to determine inner and outer bounds on the domain of the constrained macroscopic elastoplastic energy density, or equivalently, the affine boundary values of a related inhomogeneous differential inclusion problem. A geometry independent Taylor inner bound, which we calculate directly, follows from considering constant strain solutions to a relaxed problem in combination with well known relaxation and convex integration results. On the other hand, we deduce outer bounds from a rank one compatibility condition between the affine boundary data and the microscopic strain at the boundary grains. While there are examples of polycrystals for which the two above mentioned bounds coincide, we present an explicit construction to prove that the Taylor bound is non optimal in general.


BCH codes over gf(q) with length q m 1 . BCH codes are an interesting class of cyclic codes due to their efficient encoding and decoding algorithms. In many cases, BCH codes are the best linear codes. However, the dimension and minimum distance of BCH codes have been seldom solved. Until now, there have been few results on BCH codes over gf(q) with length q m 1 , especially when q is a prime power and m is even. The objective of this paper is to study BCH codes of this type over finite fields and analyse their parameters. The BCH codes presented in this paper have good parameters in general, and contain many optimal linear codes.


Local and global scalar curvature rigidity of Einstein manifolds. An Einstein manifold is called scalar curvature rigid if there are no compactly supported volume preserving deformation of the metric which increase the scalar curvature. We give various characterizations of scalar curvature rigidity for open Einstein manifolds as well as for closed Einstein manifolds. As an application, we construct mass decreasing perturbations of the Riemannian Schwarzschild metric and the Taub Bolt metric.


Towards a direct measurement of the quantum vacuum Lagrangian coupling coefficients using two counter propagating super intense laser pulses. In this paper we will show that photon photon collision experiments using extreme lasers can provide measurable effects giving fundamental information about the essence of QED, its Lagrangian. A possible scenario with two counterpropagating ultraintense lasers for an experiment to detect scattering between optical photons is analyzed. We discuss the importance of the pulse widths and waists, the best scenario for overlapping the beams and signal detection, as well as ways to distinguish the signal from the noise. This would need a high precision measurement, with control of temporal jitter and noise. We conclude that such experiment is barely feasible at 10 23 W cm 2 and very promising at 10 24 W cm 2


Synthesis and optoelectronic properties of CdSe quantum dots. A series of Cadmium Selenide nanoparticles in the range of 6 12 nm have been synthesized by a wet chemical route that employs Mercaptoethanol as a capping agent. These nanoparticles have been characterized by Ultraviolet visible (UV VIS) absorption, photoluminescence spectroscopy, and X RAY diffraction (XRD). The effect of concentration on the optical spectra has been investigated whereas Mercaptoethanol which is a growth limiting agent, prevents bulking. The augmentation of concentration of Mercaptoethanol decreases the size of Cadmium Selenide nanoparticles and shifts the peaks of absorption spectra


This Face Does Not Exist ... But It Might Be Yours! Identity Leakage in Generative Models. Generative adversarial networks (GANs) are able to generate high resolution photo realistic images of objects that "do not exist." These synthetic images are rather difficult to detect as fake. However, the manner in which these generative models are trained hints at a potential for information leakage from the supplied training data, especially in the context of synthetic faces. This paper presents experiments suggesting that identity information in face images can flow from the training corpus into synthetic samples without any adversarial actions when building or using the existing model. This raises privacy related questions, but also stimulates discussions of (a) the face manifold's characteristics in the feature space and (b) how to create generative models that do not inadvertently reveal identity information of real subjects whose images were used for training. We used five different face matchers (face recognition, FaceNet, ArcFace, SphereFace and Neurotechnology MegaMatcher) and the StyleGAN2 synthesis model, and show that this identity leakage does exist for some, but not all methods. So, can we say that these synthetically generated faces truly do not exist? Databases of real and synthetically generated faces are made available with this paper to allow full replicability of the results discussed in this work.


Lessons from AlphaZero for Optimal, Model Predictive, and Adaptive Control. In this paper we aim to provide analysis and insights (often based on visualization), which explain the beneficial effects of on line decision making on top of off line training. In particular, through a unifying abstract mathematical framework, we show that the principal AlphaZero TD Gammon ideas of approximation in value space and rollout apply very broadly to deterministic and stochastic optimal control problems, involving both discrete and continuous search spaces. Moreover, these ideas can be effectively integrated with other important methodologies such as model predictive control, adaptive control, decentralized control, discrete and Bayesian optimization, neural network based value and policy approximations, and heuristic algorithms for discrete optimization.


HARA A Hierarchical Approach for Robust Rotation Averaging. We propose a novel hierarchical approach for multiple rotation averaging, dubbed HARA. Our method incrementally initializes the rotation graph based on a hierarchy of triplet support. The key idea is to build a spanning tree by prioritizing the edges with many strong triplet supports and gradually adding those with weaker and fewer supports. This reduces the risk of adding outliers in the spanning tree. As a result, we obtain a robust initial solution that enables us to filter outliers prior to nonlinear optimization. With minimal modification, our approach can also integrate the knowledge of the number of valid 2D 2D correspondences. We perform extensive evaluations on both synthetic and real datasets, demonstrating state of the art results.


Parameterized Repair of Concurrent Systems. We present an algorithm for the repair of parameterized systems. The repair problem is, for a given process implementation, to find a refinement such that a given property is satisfied by the resulting parameterized system, and deadlocks are avoided. Our algorithm employs a constraint based search for candidate repairs, and uses a parameterized model checker to determine their correctness and update the constraint system in case errors are reachable. We apply this algorithm on systems that can be represented as well structured transition systems (WSTS), including disjunctive systems, pairwise rendezvous systems, and broadcast protocols. Moreover, we show that parameterized deadlock detection can be decided in NEXPTIME for disjunctive systems, vastly improving on the best known lower bound, and that it is in general undecidable for broadcast protocols.


Differentially Private Sublinear Time Clustering. Clustering is an essential primitive in unsupervised machine learning. We bring forth the problem of sublinear time differentially private clustering as a natural and well motivated direction of research. We combine the k means and k median sublinear time results of Mishra et al. (SODA, 2001) and of Czumaj and Sohler (Rand. Struct. and Algorithms, 2007) with recent results on private clustering of Balcan et al. (ICML 2017), Gupta et al. (SODA, 2010) and Ghazi et al. (NeurIPS, 2020) to obtain sublinear time private k means and k median algorithms via subsampling. We also investigate the privacy benefits of subsampling for group privacy.


Generalized tournament matrices with the same principal minors. A generalized tournament matrix M is a nonnegative matrix that satisfies M M t J I , where J is the all ones matrix and I is the identity matrix. In this paper, a characterization of generalized tournament matrices with the same principal minors of orders 2 , 3 , and 4 is given. In particular, it is proven that the principal minors of orders 2 , 3 , and 4 determine the rest of the principal minors.


Variational Structured Attention Networks for Deep Visual Representation Learning. Convolutional neural networks have enabled major progresses in addressing pixel level prediction tasks such as semantic segmentation, depth estimation, surface normal prediction and so on, benefiting from their powerful capabilities in visual representation learning. Typically, state of the art models integrate attention mechanisms for improved deep feature representations. Recently, some works have demonstrated the significance of learning and combining both spatial and channelwise attentions for deep feature refinement. In this paper, weaim at effectively boosting previous approaches and propose a unified deep framework to jointly learn both spatial attention maps and channel attention vectors in a principled manner so as to structure the resulting attention tensors and model interactions between these two types of attentions. Specifically, we integrate the estimation and the interaction of the attentions within a probabilistic representation learning framework, leading to VarIational STructured Attention networks (VISTA Net). We implement the inference rules within the neural network, thus allowing for end to end learning of the probabilistic and the CNN frontend parameters. As demonstrated by our extensive empirical evaluation on six large scale datasets for dense visual prediction, VISTA Net outperforms the state of the art in multiple continuous and discrete prediction tasks, thus confirming the benefit of the proposed approach in joint structured spatial channel attention estimation for deep representation learning. The code is available at https github.com ygjwd12345 VISTA Net.


Single Layer Vision Transformers for More Accurate Early Exits with Less Overhead. Deploying deep learning models in time critical applications with limited computational resources, for instance in edge computing systems and IoT networks, is a challenging task that often relies on dynamic inference methods such as early exiting. In this paper, we introduce a novel architecture for early exiting based on the vision transformer architecture, as well as a fine tuning strategy that significantly increase the accuracy of early exit branches compared to conventional approaches while introducing less overhead. Through extensive experiments on image and audio classification as well as audiovisual crowd counting, we show that our method works for both classification and regression problems, and in both single and multi modal settings. Additionally, we introduce a novel method for integrating audio and visual modalities within early exits in audiovisual data analysis, that can lead to a more fine grained dynamic inference.


On groups of finite upper rank. The upper rank' of a group is the supremum of the (Pr " u fer) ranks of its finite quotients, and for a prime p , the upper p rank' is the supremum of the sectional p ranks of those quotients. The former is finite if and only if the latter are finitely bounded as p ranges over all primes (a deep fact). Here we discuss the question if the upper p ranks of a finitely generated group G are all finite, are they necessarily bounded? The case where G is a soluble group is still an open problem.


Super resolution of multiphase materials by combining complementary 2D and 3D image data using generative adversarial networks. Modelling the impact of a material's mesostructure on device level performance typically requires access to 3D image data containing all the relevant information to define the geometry of the simulation domain. This image data must include sufficient contrast between phases to distinguish each material, be of high enough resolution to capture the key details, but also have a large enough field of view to be representative of the material in general. It is rarely possible to obtain data with all of these properties from a single imaging technique. In this paper, we present a method for combining information from pairs of distinct but complementary imaging techniques in order to accurately reconstruct the desired multi phase, high resolution, representative, 3D images. Specifically, we use deep convolutional generative adversarial networks to implement super resolution, style transfer and dimensionality expansion. To demonstrate the widespread applicability of this tool, two pairs of datasets are used to validate the quality of the volumes generated by fusing the information from paired imaging techniques. Three key mesostructural metrics are calculated in each case to show the accuracy of this method. Having confidence in the accuracy of our method, we then demonstrate its power by applying to a real data pair from a lithium ion battery electrode, where the required 3D high resolution image data is not available anywhere in the literature. We believe this approach is superior to previously reported statistical material reconstruction methods both in terms of its fidelity and ease of use. Furthermore, much of the data required to train this algorithm already exists in the literature, waiting to be combined. As such, our open access code could precipitate a step change by generating the hard to obtain high quality image volumes necessary to simulate behaviour at the mesoscale.


A Novel Deep Learning Method for Textual Sentiment Analysis. Sentiment analysis is known as one of the most crucial tasks in the field of natural language processing and Convolutional Neural Network (CNN) is one of those prominent models that is commonly used for this aim. Although convolutional neural networks have obtained remarkable results in recent years, they are still confronted with some limitations. Firstly, they consider that all words in a sentence have equal contributions in the sentence meaning representation and are not able to extract informative words. Secondly, they require a large number of training data to obtain considerable results while they have many parameters that must be accurately adjusted. To this end, a convolutional neural network integrated with a hierarchical attention layer is proposed which is able to extract informative words and assign them higher weight. Moreover, the effect of transfer learning that transfers knowledge learned in the source domain to the target domain with the aim of improving the performance is also explored. Based on the empirical results, the proposed model not only has higher classification accuracy and can extract informative words but also applying incremental transfer learning can significantly enhance the classification performance.


C BSE ( Delta(A)) as a dual Banach algebra. Let ( X , d ) be a metric space and A be a commutative Banach algebra such that Delta ( A ) be nonempty. In this paper, we provide necessary and sufficient conditions, under which C BSE ( Delta (A) ) is a Dual Banach algebra. Moreover, we provide some conditions for that Lip alpha ( X , A ) is a Dual Banach algebra.


Learning Inertial Odometry for Dynamic Legged Robot State Estimation. This paper introduces a novel proprioceptive state estimator for legged robots based on a learned displacement measurement from IMU data. Recent research in pedestrian tracking has shown that motion can be inferred from inertial data using convolutional neural networks. A learned inertial displacement measurement can improve state estimation in challenging scenarios where leg odometry is unreliable, such as slipping and compressible terrains. Our work learns to estimate a displacement measurement from IMU data which is then fused with traditional leg odometry. Our approach greatly reduces the drift of proprioceptive state estimation, which is critical for legged robots deployed in vision and lidar denied environments such as foggy sewers or dusty mines. We compared results from an EKF and an incremental fixed lag factor graph estimator using data from several real robot experiments crossing challenging terrains. Our results show a reduction of relative pose error by 37 in challenging scenarios when compared to a traditional kinematic inertial estimator without learned measurement. We also demonstrate a 22 reduction in error when used with vision systems in visually degraded environments such as an underground mine.


A Hitting Set Relaxation for k Server and an Extension to Time Windows. We study the k server problem with time windows. In this problem, each request i arrives at some point v i of an n point metric space at time b i and comes with a deadline e i . One of the k servers must be moved to v i at some time in the interval b i, e i to satisfy this request. We give an online algorithm for this problem with a competitive ratio of rm polylog (n, Delta) , where Delta is the aspect ratio of the metric space. Prior to our work, the best competitive ratio known for this problem was O(k cdot rm polylog (n)) given by Azar et al. (STOC 2017). Our algorithm is based on a new covering linear program relaxation for k server on HSTs. This LP naturally corresponds to the min cost flow formulation of k server, and easily extends to the case of time windows. We give an online algorithm for obtaining a feasible fractional solution for this LP, and a primal dual analysis framework for accounting the cost of the solution. Together, they yield a new k server algorithm with poly logarithmic competitive ratio, and extend to the time windows case as well. Our principal technical contribution lies in thinking of the covering LP as yielding a em truncated covering LP at each internal node of the tree, which allows us to keep account of server movements across subtrees. We hope that this LP relaxation and the algorithm analysis will be a useful tool for addressing k server and related problems.


An alternative axiomatic presentation of Nelson algebras. Nelson algebras are defined in Diana Brignole and Ant 'onio Monteiro. Caract 'erisation des alg ebres de Nelson par des 'egalit 'es. I , II . Proc. Japan Acad., 43 279 283 284 285, 1967. in terms of the language langle land, lor, to, sim,1 rangle . In 1962, Diana Brignole Diana Brignole. Axiomatizaci 'on de un N reticulado. Revista de la Uni 'on Matem 'atica Argentina, XXI(3) 147 148, 1965. , solved the problem proposed by Antonio Monteiro, of giving an axiomatization of Nelson algebras in terms of the connectives rightarrowtail , land and the constant 0 sim 1 . In this work, we present for the first time a complete proof of this fact, and also show the dependence and independence of some of the axioms proposed by Brignole.


Active Tapping via Gaussian Process for Efficient Unknown Object Surface Reconstruction. Object surface reconstruction brings essential benefits to robot grasping, object recognition, and object manipulation. When measuring the surface distribution of an unknown object by tapping, the greatest challenge is to select tapping positions efficiently and accurately without prior knowledge of object region. Given a searching range, we propose an active exploration method, to efficiently and intelligently guide the tapping to learn the object surface without exhaustive and unnecessary off surface tapping. We analyze the performance of our approach in modeling object surfaces within an exploration range larger than the object using a robot arm equipped with an end of arm tapping tool to execute tapping motions. Experimental results show that the approach successfully models the surface of unknown objects with a relative 59 improvement in the proportion of necessary taps among all taps compared with state of art performance.


Multiparameter persistent homology via generalized Morse theory. We define a class of multiparameter persistence modules that arise from a one parameter family of functions on a topological space. In the case of smooth functions on a compact manifold, we apply cobordism theory and Cerf theory to study the resulting persistence modules. We give examples in which we obtain a complete description of the persistence module as a direct sum of indecomposable summands and provide a corresponding visualization.


Citations or dollars? Early signals of a firm's research success. Scientific and technological progress is largely driven by firms in many domains, including artificial intelligence and vaccine development. However, we do not know yet whether the success of firms' research activities exhibits dynamic regularities and some degree of predictability. By inspecting the research lifecycles of 7,440 firms, we find that the economic value of a firm's early patents is an accurate predictor of various dimensions of a firm's future research success. At the same time, a smaller set of future top performers do not generate early patents of high economic value, but they are detectable via the technological value of their early patents. Importantly, the observed predictability cannot be explained by a cumulative advantage mechanism, and the observed heterogeneity of the firms' temporal success patterns markedly differs from patterns previously observed for individuals' research careers. Our results uncover the dynamical regularities of the research success of firms, and they could inform managerial strategies as well as policies to promote entrepreneurship and accelerate human progress.


An Empirical Study on Serverless Workflow Service. Along with the wide adoption of Serverless Computing, more and more applications are developed and deployed on cloud platforms. Major cloud providers present their serverless workflow services to orchestrate serverless functions, making it possible to perform complex applications effectively. A comprehensive instruction is necessary to help developers understand the pros and cons, and make better choices among these serverless workflow services. However, the characteristics of these serverless workflow services have not been systematically analyzed. To fill the knowledge gap, we survey four mainstream serverless workflow services, investigating their characteristics and performance. Specifically, we review their official documents and compare them in terms of seven dimensions including programming model, state management, etc. Then, we compare the performance (i.e., execution time of functions, execution time of workflows, orchestration overhead of workflows) under various experimental settings considering activity complexity and data flow complexity of workflows, as well as function complexity of serverless functions. Finally, we discuss and verify the service effectiveness for two actual workloads. Our findings could help application developers and serverless providers to improve the development efficiency and user experience.


Scalable Teacher Forcing Network for Semi Supervised Large Scale Data Streams. The large scale data stream problem refers to high speed information flow which cannot be processed in scalable manner under a traditional computing platform. This problem also imposes expensive labelling cost making the deployment of fully supervised algorithms unfeasible. On the other hand, the problem of semi supervised large scale data streams is little explored in the literature because most works are designed in the traditional single node computing environments while also being fully supervised approaches. This paper offers Weakly Supervised Scalable Teacher Forcing Network (WeScatterNet) to cope with the scarcity of labelled samples and the large scale data streams simultaneously. WeScatterNet is crafted under distributed computing platform of Apache Spark with a data free model fusion strategy for model compression after parallel computing stage. It features an open network structure to address the global and local drift problems while integrating a data augmentation, annotation and auto correction ( DA 3 ) method for handling partially labelled data streams. The performance of WeScatterNet is numerically evaluated in the six large scale data stream problems with only 25 label proportions. It shows highly competitive performance even if compared with fully supervised learners with 100 label proportions.


A Method for Numerical Solution of Third Kind Volterra Integral Equations Using Krall Laguerre Polynomials. The present study proposed a method for numerical solution of linear Volterra integral equations (VIEs) of the third kind, before only analytical solution methods had been discussed with reference to previous research and review of the related literature. Given that such analytical solutions are not almost always feasible, it is required to provide a numerical method for solving the mentioned equations. Accordingly, Krall Laguerre polynomials were utilized for numerical solution of these equations. The main purpose of this method is to approximate the unknown functions through Krall Laguerre polynomials. Moreover, an error analysis is performed on the proposed method.


Optimal cooling of an internally heated disc. Motivated by the search for sharp bounds on turbulent heat transfer as well as the design of optimal heat exchangers, we consider incompressible flows that most efficiently cool an internally heated disc. Heat enters via a distributed source, is passively advected and diffused, and exits through the boundary at a fixed temperature. We seek an advecting flow to optimize this exchange. Previous work on energy constrained cooling with a constant source has conjectured that global optimizers should resemble convection rolls we prove one sided bounds on energy constrained cooling corresponding to, but not resolving, this conjecture. In the case of an enstrophy constraint, our results are more complete we construct a family of self similar, tree like branching flows'' whose cooling we prove is within a logarithm of globally optimal. These results hold for general space and time dependent source sink distributions that add more heat than they remove. Our main technical tool is a non local Dirichlet like variational principle for bounding solutions of the inhomogeneous advection diffusion equation with a divergence free velocity.


Sherman A Write Optimized Distributed B Tree Index on Disaggregated Memory. Memory disaggregation architecture physically separates CPU and memory into independent components, which are connected via high speed RDMA networks, greatly improving resource utilization of databases. However, such an architecture poses unique challenges to data indexing in databases due to limited RDMA semantics and near zero computation power at memory side. Existing indexes supporting disaggregated memory either suffer from low write performance, or require hardware modification. This paper presents Sherman, a write optimized distributed B Tree index on disaggregated memory that delivers high performance with commodity RDMA NICs. Sherman combines RDMA hardware features and RDMA friendly software techniques to boost index write performance from three angles. First, to reduce round trips, Sherman coalesces dependent RDMA commands by leveraging in order delivery property of RDMA. Second, to accelerate concurrent accesses, Sherman introduces a hierarchical lock that exploits on chip memory of RDMA NICs. Finally, to mitigate write amplification, Sherman tailors the data structure layout of B Tree with a two level version mechanism. Our evaluation shows that, Sherman is one order of magnitude faster in terms of both throughput and 99th percentile latency on typical write intensive workloads, compared with state of the art designs.


A universal deep learning strategy for designing high quality factor photonic resonances. Resonance is instrumental in modern optics and photonics for novel phenomena such as cavity quantum electrodynamics and electric field induced transparency. While one can use numerical simulations to sweep geometric and material parameters of optical structures, these simulations usually require considerably long calculation time (spanning from several hours to several weeks) and substantial computational resources. Such requirements significantly limit their applicability in understanding and inverse designing structures with desired resonance performances. Recently, the introduction of artificial intelligence allows for faster predictions of resonance with less demanding computational requirements. However, current end to end deep learning approaches generally fail to predict resonances with high quality factors (Q factor). Here, we introduce a universal deep learning strategy that can predict ultra high Q factor resonances by decomposing spectra with an adaptive data acquisition (ADA) method while incorporating resonance information. We exploit bound states in the continuum (BICs) with an infinite Q factor to testify this resonance informed deep learning (RIDL) strategy. The trained RIDL strategy achieves high accuracy prediction of reflection spectra and photonic band structures while using a considerably small training dataset. We further develop an inverse design algorithm based on the RIDL strategy for a symmetry protected BIC on a suspended silicon nitride photonic crystal (PhC) slab. The predicted and measured angle resolved band structures show minimum differences. We expect the RIDL strategy to apply to many other physical phenomena which exhibit Gaussian, Lorentzian, and Fano resonances.


Generalised Andr 'e Pink Zannier Conjecture for Shimura varieties of abelian type. In this paper we prove the generalised Andr 'e Pink Zannier conjecture (an important case of the Zilber Pink conjecture) for all Shimura varieties of abelian type. Questions of this type were first asked by Y. Andr 'e in 1989. We actually prove a general statement for all Shimura varieties, subject to certain assumptions that are satisfied for Shimura varieties of abelian type and are expected to hold in general.


Protect the Intellectual Property of Dataset against Unauthorized Use. Training high performance Deep Neural Networks (DNNs) models require large scale and high quality datasets. The expensive cost of collecting and annotating large scale datasets make the valuable datasets can be considered as the Intellectual Property (IP) of the dataset owner. To date, almost all the copyright protection schemes for deep learning focus on the copyright protection of models, while the copyright protection of the dataset is rarely studied. In this paper, we propose a novel method to actively protect the dataset from being used to train DNN models without authorization. Experimental results on on CIFAR 10 and TinyImageNet datasets demonstrate the effectiveness of the proposed method. Compared with the model trained on clean dataset, the proposed method can effectively make the test accuracy of the unauthorized model trained on protected dataset drop from 86.21 to 38.23 and from 74.00 to 16.20 on CIFAR 10 and TinyImageNet datasets, respectively.


Searching for Multi Fault Programs in Defects4J. Defects4J has enabled numerous software testing and debugging research work since its introduction. A large part of its contribution, and the resulting popularity, lies in the clear separation and distillation of the root cause of each individual test failure based on careful manual analysis, which in turn allowed researchers to easily study individual faults in isolation. However, in a realistic debugging scenario, multiple faults can coexist and affect test results collectively. Study of automated debugging techniques for these situations, such as failure clustering or fault localisation for multiple faults, would significantly benefit from a reliable benchmark of multiple, coexisting faults. We search for versions of Defects4J subjects that contain multiple faults, by iteratively transplanting fault revealing test cases across Defects4J versions. Out of 326 studied versions of Defects4J subjects, we report that over 95 (311 versions) actually contain from two to 24 faults. We hope that the extended, multi fault Defects4J can provide a platform for future research of testing and debugging techniques for multi fault programs.


EgoRenderer Rendering Human Avatars from Egocentric Camera Images. We present EgoRenderer, a system for rendering full body neural avatars of a person captured by a wearable, egocentric fisheye camera that is mounted on a cap or a VR headset. Our system renders photorealistic novel views of the actor and her motion from arbitrary virtual camera locations. Rendering full body avatars from such egocentric images come with unique challenges due to the top down view and large distortions. We tackle these challenges by decomposing the rendering process into several steps, including texture synthesis, pose construction, and neural image translation. For texture synthesis, we propose Ego DPNet, a neural network that infers dense correspondences between the input fisheye images and an underlying parametric body model, and to extract textures from egocentric inputs. In addition, to encode dynamic appearances, our approach also learns an implicit texture stack that captures detailed appearance variation across poses and viewpoints. For correct pose generation, we first estimate body pose from the egocentric view using a parametric model. We then synthesize an external free viewpoint pose image by projecting the parametric model to the user specified target viewpoint. We next combine the target pose image and the textures into a combined feature image, which is transformed into the output color image using a neural image translation network. Experimental evaluations show that EgoRenderer is capable of generating realistic free viewpoint avatars of a person wearing an egocentric camera. Comparisons to several baselines demonstrate the advantages of our approach.


Generalizations of the Euler Mascheroni constant associated with the hyperharmonic numbers. In this paper, we present two new generalizations of the Euler Mascheroni constant arising from the Dirichlet series associated to the hyperharmonic numbers. We also give some inequalities related to upper and lower estimates, and evaluation formulas.


Towards an extended taxonomy of information dynamics via Integrated Information Decomposition. Complex systems, from the human brain to the global economy, are made of multiple elements that interact in such ways that the behaviour of the whole' often seems to be more than what is readily explainable in terms of the sum of the parts.' Our ability to understand and control these systems remains limited, one reason being that we still don't know how best to describe and quantify the higher order dynamical interactions that characterise their complexity. To address this limitation, we combine principles from the theories of Information Decomposition and Integrated Information into what we call Integrated Information Decomposition, or Phi ID. Phi ID provides a comprehensive framework to reason about, evaluate, and understand the information dynamics of complex multivariate systems. Phi ID reveals the existence of previously unreported modes of collective information flow, providing tools to express well known measures of information transfer and dynamical complexity as aggregates of these modes. Via computational and empirical examples, we demonstrate that Phi ID extends our explanatory power beyond traditional causal discovery methods with profound implications for the study of complex systems across disciplines.


Certifying the novelty of equichordal tight fusion frames. An equichordal tight fusion frame (ECTFF) is a finite sequence of equi dimensional subspaces of a finite dimensional Hilbert space that achieves equality in Conway, Hardin and Sloane's simplex bound. Every ECTFF is a type of optimal Grassmannian code, being a way to arrange a given number of members of a Grassmannian so that the minimal chordal distance between any pair of them is as large as possible. Any nontrivial ECTFF has both a Naimark complement and spatial complement which themselves are ECTFFs. It turns out that whenever the number of subspaces is at least five, taking iterated alternating Naimark and spatial complements of one ECTFF yields an infinite family of them with distinct parameters. This makes it challenging to certify the novelty of any recently discovered ECTFF how can one guarantee that it does not arise from any previously known construction in such a Naimark spatial way? In this paper, we propose a solution to this problem, showing that any ECTFF is a member of a Naimark spatial family originating from either a trivial ECTFF or one with unique "minimal" parameters. In the latter case, if its minimal parameters do not match those of any previously known ECTFF, it is certifiably new. As a proof of concept, we then use these ideas to certify the novelty of some ECTFFs arising from a new method for constructing them from difference families for finite abelian groups. This method properly generalizes King's construction of ECTFFs from semiregular divisible difference sets.