Morse Theoretic Templates for High Dimensional Homology Computation. We introduce the notion of a template for discrete Morse theory. Templates provide a memory efficient approach to the computation of homological invariants (e.g., homology, persistent homology, Conley complexes) of cell complexes. We demonstrate the effectiveness of templates in two settings first, by computing the homology of certain cubical complexes which are homotopy equivalent to mathbb S d for 1 leq d leq 20 , and second, by computing Conley complexes and connection matrices for a collection of examples arising from a Conley Morse theory on spaces of braids diagrams.


Analog of modulus of convexity for Grand Lebesgue Spaces. We introduce and evaluate the degree of convexity of an unit ball, so called, characteristic of convexity (COC) for the Grand Lebesgue Spaces, (GLS), which is a slight analog of the classical notion of the modulus of convexity (MOC).


Rigidity of proper holomorphic maps among generalized balls with Levi degenerate boundaries. In this paper we studied a broader type of generalized balls which are domains on the complex projective with possibly Levi degenerate boundaries. We proved rigidity theorems for proper holomorphic mappings among them by exploring the structure of the moduli spaces of projective linear subspaces, which generalized some earlier results for the ordinary generalized balls with Levi nondegenerate boundaries.


Semiparametric Latent Topic Modeling on Consumer Generated Corpora. Legacy procedures for topic modelling have generally suffered problems of overfitting and a weakness towards reconstructing sparse topic structures. With motivation from a consumer generated corpora, this paper proposes semiparametric topic model, a two step approach utilizing nonnegative matrix factorization and semiparametric regression in topic modeling. The model enables the reconstruction of sparse topic structures in the corpus and provides a generative model for predicting topics in new documents entering the corpus. Assuming the presence of auxiliary information related to the topics, this approach exhibits better performance in discovering underlying topic structures in cases where the corpora are small and limited in vocabulary. In an actual consumer feedback corpus, the model also demonstrably provides interpretable and useful topic definitions comparable with those produced by other methods.


AFDM A Full Diversity Next Generation Waveform for High Mobility Communications. We present Affine Frequency Division Multiplexing (AFDM), a new chirp based multicarrier transceiver scheme for high mobility communications in next generation wireless systems. AFDM is based on discrete affine Fourier transform (DAFT), a generalization of discrete Fourier transform characterized with two parameters that can be adapted to better cope with doubly dispersive channels. Based on the derived input output relation, the DAFT parameters underlying AFDM are set in such a way to avoid that time domain channel paths with distinct delays or Doppler frequency shifts overlap in the DAFT domain. The resulting DAFT domain impulse response thus conveys a full delay Doppler representation of the channel. We show that AFDM can achieve the full diversity of linear time varying (LTV) channels. Our analytical results are validated through numerical simulations, which evince that AFDM outperforms state of the art multicarrier schemes in terms of bit error rate (BER) in doubly dispersive channels.


AMPPERE A Universal Abstract Machine for Privacy Preserving Entity Resolution Evaluation. Entity resolution is the task of identifying records in different datasets that refer to the same entity in the real world. In sensitive domains (e.g. financial accounts, hospital health records), entity resolution must meet privacy requirements to avoid revealing sensitive information such as personal identifiable information to untrusted parties. Existing solutions are either too algorithmically specific or come with an implicit trade off between accuracy of the computation, privacy, and run time efficiency. We propose AMMPERE, an abstract computation model for performing universal privacy preserving entity resolution. AMPPERE offers abstractions that encapsulate multiple algorithmic and platform agnostic approaches using variants of Jaccard similarity to perform private data matching and entity resolution. Specifically, we show that two parties can perform entity resolution over their data, without leaking sensitive information. We rigorously compare and analyze the feasibility, performance overhead and privacy preserving properties of these approaches on the Sharemind multi party computation (MPC) platform as well as on PALISADE, a lattice based homomorphic encryption library. The AMPPERE system demonstrates the efficacy of privacy preserving entity resolution for real world data while providing a precise characterization of the induced cost of preventing information leakage.


Reallocation Problems with Minimum Completion Time. Reallocation scheduling is one of the most fundamental problems in various areas such as supply chain management, logistics, and transportation science. In this paper, we introduce the reallocation problem that models the scheduling in which products are with fixed cost, non fungible, and reallocated in parallel, and comprehensively study the complexity of the problem under various settings of the transition time, product size, and capacities. We show that the problem can be solved in polynomial time for a fundamental setting where the product size and transition time are both uniform. We also show that the feasibility of the problem is NP complete even for little more general settings, which implies that no polynomial time algorithm constructs a feasible schedule of the problem unless P NP. We then consider the relaxation of the problem, which we call the capacity augmentation, and derive a reallocation schedule feasible with the augmentation such that the completion time is at most the optimal of the original problem. When the warehouse capacity is sufficiently large, we design constant factor approximation algorithms under all the settings. We also show the relationship between the reallocation problem and the bin packing problem when the warehouse and carry in capacities are sufficiently large.


Machine learning based disease diagnosis A comprehensive review. Globally, there is a substantial unmet need to diagnose various diseases effectively. The complexity of the different disease mechanisms and underlying symptoms of the patient population presents massive challenges to developing the early diagnosis tool and effective treatment. Machine Learning (ML), an area of Artificial Intelligence (AI), enables researchers, physicians, and patients to solve some of these issues. Based on relevant research, this review explains how Machine Learning (ML) and Deep Learning (DL) are being used to help in the early identification of numerous diseases. To begin, a bibliometric study of the publication is given using data from the Scopus and Web of Science (WOS) databases. The bibliometric study of 1216 publications was undertaken to determine the most prolific authors, nations, organizations, and most cited articles. The review then summarizes the most recent trends and approaches in Machine Learning based Disease Diagnosis (MLBDD), considering the following factors algorithm, disease types, data type, application, and evaluation metrics. Finally, the paper highlights key results and provides insight into future trends and opportunities in the MLBDD area.


Defect Detection on Semiconductor Wafers by Distribution Analysis. A method for object classification that is based on distribution analysis is proposed. In addition, a method for finding relevant features and the unification of this algorithm with another classification algorithm is proposed. The presented classification algorithm has been applied successfully to real world measurement data from wafer fabrication of close to hundred thousand chips of several product types. The presented algorithm prefers finding the best rater in a low dimensional search space over finding a good rater in a high dimensional search space. Our approach is interesting in that it is fast (quasi linear) and reached good to excellent prediction or detection quality for real world wafer data.


A finite element elasticity complex in three dimensions. A finite element elasticity complex on tetrahedral meshes is devised. The H 1 conforming finite element is the smooth finite element developed by Neilan for the velocity field in a discrete Stokes complex. The symmetric div conforming finite element is the Hu Zhang element for stress tensors. The construction of an H( textrm inc ) conforming finite element for symmetric tensors is the main focus of this paper. The key tools of the construction are the decomposition of polynomial tensor spaces and the characterization of the trace of the textrm inc operator. The polynomial elasticity complex and Koszul elasticity complex are created to derive the decomposition of polynomial tensor spaces. The trace of the textrm inc operator is induced from a Green's identity. Trace complexes and bubble complexes are also derived to facilitate the construction. Our construction appears to be the first H( textrm inc ) conforming finite elements on tetrahedral meshes without further splits.


Binary quadratic forms and sums of powers of integers. In this methodological paper, we first review the classic cubic Diophantine equation a 3 b 3 c 3 d 3 , and consider the specific class of solutions q 1 3 q 2 3 q 3 3 q 4 3 with each q i being a binary quadratic form. Next we turn our attention to the familiar sums of powers of the first n positive integers, S k 1 k 2 k cdots n k , and express the squares S k 2 , S m 2 , and the product S k S m as a linear combination of power sums. These expressions, along with the above quadratic form solution for the cubic equation, allows one to generate an infinite number of relations of the form Q 1 3 Q 2 3 Q 3 3 Q 4 3 , with each Q i being a linear combination of power sums. Also, we briefly consider the quadratic Diophantine equations a 2 b 2 c 2 d 2 and a 2 b 2 c 2 , and give a family of corresponding solutions Q 1 2 Q 2 2 Q 3 2 Q 4 2 and Q 1 2 Q 2 2 Q 3 2 in terms of sums of powers of integers.


The Large Labelled Logo Dataset (L3D) A Multipurpose and Hand Labelled Continuously Growing Dataset. In this work, we present the Large Labelled Logo Dataset (L3D), a multipurpose, hand labelled, continuously growing dataset. It is composed of around 770k of color 256x256 RGB images extracted from the European Union Intellectual Property Office (EUIPO) open registry. Each of them is associated to multiple labels that classify the figurative and textual elements that appear in the images. These annotations have been classified by the EUIPO evaluators using the Vienna classification, a hierarchical classification of figurative marks. We suggest two direct applications of this dataset, namely, logo classification and logo generation.


Question Generation for Adaptive Education. Intelligent and adaptive online education systems aim to make high quality education available for a diverse range of students. However, existing systems usually depend on a pool of hand made questions, limiting how fine grained and open ended they can be in adapting to individual students. We explore targeted question generation as a controllable sequence generation task. We first show how to fine tune pre trained language models for deep knowledge tracing (LM KT). This model accurately predicts the probability of a student answering a question correctly, and generalizes to questions not seen in training. We then use LM KT to specify the objective and data for training a model to generate questions conditioned on the student and target difficulty. Our results show we succeed at generating novel, well calibrated language translation questions for second language learners from a real online education platform.


Attenuation of surface modes in granular media. In this work, an unconsolidated granular medium, made of silica microbeads, is experimentally tested in a laboratory setting. The objective is to investigate the attenuation mechanisms of vertically polarized seismic waves traveling at the surface of unconsolidated substrates that are characterized by power law rigidity profiles. Both geometric spreading and material damping due to skeletal dissipation are considered. An electromagnetic shaker is employed to excite the granular medium between 300 and 550 Hz, generating linear modes that are localized near the surface. A densely sampled section is recorded at the surface using a laser vibrometer. The explicit solution of the geometric attenuation law of Rayleigh like waves in layered media is employed to calculate the geometric spreading function of the vertically polarized surface modes within the granular material. In accordance with recent studies, the dynamics of these small amplitude multi modal linear waves can be analysed by considering the granular medium as perfectly continuous and elastic. By performing a non linear regression analysis on particle displacements, extracted from experimental velocity data, we determine the frequency dependent attenuation coefficients, which account for the material damping. The findings of this work show that laboratory scale physical models can be used to study the geometric spreading of vertically polarized seismic waves induced by the soil inhomogeneity and characterize the material damping of the medium.


The Common Intuition to Transfer Learning Can Win or Lose Case Studies for Linear Regression. We study a fundamental transfer learning process from source to target linear regression tasks, including overparameterized settings where there are more learned parameters than data samples. The target task learning is addressed by using its training data together with the parameters previously computed for the source task. We define a transfer learning approach to the target task as a linear regression optimization with a regularization on the distance between the to be learned target parameters and the already learned source parameters. We analytically characterize the generalization performance of our transfer learning approach and demonstrate its ability to resolve the peak in generalization errors in double descent phenomena of the minimum ell 2 norm solution to linear regression. Moreover, we show that for sufficiently related tasks, the optimally tuned transfer learning approach can outperform the optimally tuned ridge regression method, even when the true parameter vector conforms to an isotropic Gaussian prior distribution. Namely, we demonstrate that transfer learning can beat the minimum mean square error (MMSE) solution of the independent target task. Our results emphasize the ability of transfer learning to extend the solution space to the target task and, by that, to have an improved MMSE solution. We formulate the linear MMSE solution to our transfer learning setting and point out its key differences from the common design philosophy to transfer learning.


On 3 graphs with no four vertices spanning exactly two edges. Let D 2 denote the 3 uniform hypergraph with 4 vertices and 2 edges. Answering a question of Alon and Shapira, we prove an induced removal lemma for D 2 having polynomial bounds. We also prove an Erd H o s Hajnal type result every induced D 2 free hypergraph on n vertices contains a clique or an independent set of size n c for some absolute constant c 0 . In the case of both problems, D 2 is the only nontrivial k uniform hypergraph with k geq 3 which admits a polynomial bound.


Homogenization of a thermo poro elastic medium with two components and interfacial hydraulic thermal exchange barrier. The paper addresses the homogenization of a micro model of poroelasticity coupled with thermal effects for two constituent media and with imperfect interfacial contact.The homogenized model is obtained by means of the two scale convergence technique. It is shown that the macro thermo poro elasticity model with double porosity diffusivity contains in particular some extra terms accounting for the micro heterogeneities and imperfect contact at the local scale. Finally, a corrector result is given under more regularity assumptions on the data.


Robust Price Optimization of Multiple Products under Interval Uncertainties. In this paper, we solve the multiple product price optimization problem under interval uncertainties of the price sensitivity parameters in the demand function. The objective of the price optimization problem is to maximize the overall revenue of the firm where the decision variables are the prices of the products supplied by the firm. We propose an approach that yields optimal solutions under different variations of the estimated price sensitivity parameters. We adopt a robust optimization approach by building a data driven uncertainty set for the parameters, and then construct a deterministic counterpart for the robust optimization model. The numerical results show that two objectives are fulfilled the method reflects the uncertainty embedded in parameter estimations, and also an interval is obtained for optimal prices. We also conducted a simulation study to which we compared the results of our approach. The comparisons show that although robust optimization is deemed to be conservative, the results of the proposed approach show little loss compared to those from the simulation.


Unifying Multimodal Transformer for Bi directional Image and Text Generation. We study the joint learning of image to text and text to image generations, which are naturally bi directional tasks. Typical existing works design two separate task specific models for each task, which impose expensive design efforts. In this work, we propose a unified image and text generative framework based on a single multimodal model to jointly study the bi directional tasks. We adopt Transformer as our unified architecture for its strong performance and task agnostic design. Specifically, we formulate both tasks as sequence generation tasks, where we represent images and text as unified sequences of tokens, and the Transformer learns multimodal interactions to generate sequences. We further propose two level granularity feature representations and sequence level training to improve the Transformer based unified framework. Experiments show that our approach significantly improves previous Transformer based model X LXMERT's FID from 37.0 to 29.9 (lower is better) for text to image generation, and improves CIDEr D score from 100.9 to 122.6 for fine tuned image to text generation on the MS COCO dataset. Our code is available online.


Stability of a flexible missile described by asymptotics of the eigenvalues of fourth order boundary value problems. Fourth order problems, with the differential equation y (4) (gy')' lambda 2y , where g in C 1 0,a and a 0 , occur in engineering on stability of elastic rods. They occur as well in aeronautics to describe the stability of a flexible missile. Fourth order Birkhoff regular problems with the differential equation y (4) (gy')' lambda 2y and eigenvalue dependent boundary conditions are considered. These problems have quadratic operator representations with non self adjoint operators. The first four terms of the asymptotics of the eigenvalues of the problems as well as those of the eigenvalues of the problem describing the stability of a flexible missile are evaluated explicitly.


Integral feedback in synthetic biology Negative equilibrium catastrophe. A central goal of synthetic biology is the design of molecular controllers that can manipulate the dynamics of intracellular networks in a stable and accurate manner. To address the fact that detailed knowledge about intracellular networks is unavailable, integral feedback controllers (IFCs) have been put forward for controlling molecular abundances. These controllers can maintain accuracy in spite of the uncertainties in the controlled networks. However, this desirable feature is achieved only if stability is also maintained. In this paper, we show that molecular IFCs can suffer from a hazardous instability called negative equilibrium catastrophe (NEC), whereby all nonnegative equilibria vanish under the action of the controllers, and some of the molecular abundances blow up. We show that unimolecular IFCs do not exist due to a NEC. We then derive a family of bimolecular IFCs that are safeguarded against NECs when uncertain unimolecular networks, with any number of molecular species, are controlled. However, when IFCs are applied on uncertain bimolecular (and hence most intracellular) networks, we show that preventing NECs generally becomes an intractable problem as the number of interacting molecular species increases.


Universal Background Subtraction based on Arithmetic Distribution Neural Network. We propose a universal background subtraction framework based on the Arithmetic Distribution Neural Network (ADNN) for learning the distributions of temporal pixels. In our ADNN model, the arithmetic distribution operations are utilized to introduce the arithmetic distribution layers, including the product distribution layer and the sum distribution layer. Furthermore, in order to improve the accuracy of the proposed approach, an improved Bayesian refinement model based on neighboring information, with a GPU implementation, is incorporated. In the forward pass and backpropagation of the proposed arithmetic distribution layers, histograms are considered as probability density functions rather than matrices. Thus, the proposed approach is able to utilize the probability information of the histogram and achieve promising results with a very simple architecture compared to traditional convolutional neural networks. Evaluations using standard benchmarks demonstrate the superiority of the proposed approach compared to state of the art traditional and deep learning methods. To the best of our knowledge, this is the first method to propose network layers based on arithmetic distribution operations for learning distributions during background subtraction.


A note on Barker sequences of even length. A Barker sequence is a binary sequence for which all nontrivial aperiodic autocorrelations are either 0, 1 or 1. The only known Barker sequences have length 2, 3, 4, 5, 7, 11 or 13. It is an old conjecture that no longer Barker sequences exist and in fact, there is an overwhelming evidence for this conjecture. For binary sequences of odd length, this conjecture is known to be true, whereas for even length it is still open, whether a Barker sequence of even length greater 4 exists. Similar to the well known fact that a Barker sequence of odd length is necessarily skew symmetric, we show that in the case of even length there is also a form of symmetry albeit weaker. In order to exploit this symmetry, we derive different formulas for the calculation of the aperiodic correlation. We prove by using only elementary methods that there is no Barker sequence of even length n 4 with C 1 C 3 cdots C frac n 2 1 , where C k denotes the k th aperiodic autocorrelation of the sequence.


Self Supervised Monocular Depth Estimation with Internal Feature Fusion. Self supervised learning for depth estimation uses geometry in image sequences for supervision and shows promising results. Like many computer vision tasks, depth network performance is determined by the capability to learn accurate spatial and semantic representations from images. Therefore, it is natural to exploit semantic segmentation networks for depth estimation. In this work, based on a well developed semantic segmentation network HRNet, we propose a novel depth estimation network DIFFNet, which can make use of semantic information in down and upsampling procedures. By applying feature fusion and an attention mechanism, our proposed method outperforms the state of the art monocular depth estimation methods on the KITTI benchmark. Our method also demonstrates greater potential on higher resolution training data. We propose an additional extended evaluation strategy by establishing a test set of challenging cases, empirically derived from the standard benchmark.


Contrast and Generation Make BART a Good Dialogue Emotion Recognizer. In dialogue systems, utterances with similar semantics may have distinctive emotions under different contexts. Therefore, modeling long range contextual emotional relationships with speaker dependency plays a crucial part in dialogue emotion recognition. Meanwhile, distinguishing the different emotion categories is non trivial since they usually have semantically similar sentiments. To this end, we adopt supervised contrastive learning to make different emotions mutually exclusive to identify similar emotions better. Meanwhile, we utilize an auxiliary response generation task to enhance the model's ability of handling context information, thereby forcing the model to recognize emotions with similar semantics in diverse contexts. To achieve these objectives, we use the pre trained encoder decoder model BART as our backbone model since it is very suitable for both understanding and generation tasks. The experiments on four datasets demonstrate that our proposed model obtains significantly more favorable results than the state of the art model in dialogue emotion recognition. The ablation study further demonstrates the effectiveness of supervised contrastive loss and generative loss.


Signal Propagation in a Gradient Based and Evolutionary Learning System. Generative adversarial networks (GANs) exhibit training pathologies that can lead to convergence related degenerative behaviors, whereas spatially distributed, coevolutionary algorithms (CEAs) for GAN training, e.g. Lipizzaner, are empirically robust to them. The robustness arises from diversity that occurs by training populations of generators and discriminators in each cell of a toroidal grid. Communication, where signals in the form of parameters of the best GAN in a cell propagate in four directions North, South, West, and East, also plays a role, by communicating adaptations that are both new and fit. We propose Lipi Ring, a distributed CEA like Lipizzaner, except that it uses a different spatial topology, i.e. a ring. Our central question is whether the different directionality of signal propagation (effectively migration to one or more neighbors on each side of a cell) meets or exceeds the performance quality and training efficiency of Lipizzaner Experimental analysis on different datasets (i.e, MNIST, CelebA, and COVID 19 chest X ray images) shows that there are no significant differences between the performances of the trained generative models by both methods. However, Lipi Ring significantly reduces the computational time (14.2 . . . 41.2 ). Thus, Lipi Ring offers an alternative to Lipizzaner when the computational cost of training matters.


Improved Signed Distance Function for 2D Real time SLAM and Accurate Localization. Accurate mapping and localization are very important for many industrial robotics applications. In this paper, we propose an improved Signed Distance Function (SDF) for both 2D SLAM and pure localization to improve the accuracy of mapping and localization. To achieve this goal, firstly we improved the back end mapping to build a more accurate SDF map by extending the update range and building free space, etc. Secondly, to get more accurate pose estimation for the front end, we proposed a new iterative registration method to align the current scan to the SDF submap by removing random outliers of laser scanners. Thirdly, we merged all the SDF submaps to produce an integrated SDF map for highly accurate pure localization. Experimental results show that based on the merged SDF map, a localization accuracy of a few millimeters (5mm) can be achieved globally within the map. We believe that this method is important for mobile robots working in scenarios where high localization accuracy matters.


Matrix Concentration Inequalities and Free Probability. A central tool in the study of nonhomogeneous random matrices, the noncommutative Khintchine inequality of Lust Piquard and Pisier, yields a nonasymptotic bound on the spectral norm of general Gaussian random matrices X sum i g i A i where g i are independent standard Gaussian variables and A i are matrix coefficients. This bound exhibits a logarithmic dependence on dimension that is sharp when the matrices A i commute, but often proves to be suboptimal in the presence of noncommutativity. In this paper, we develop nonasymptotic bounds on the spectrum of arbitrary Gaussian random matrices that can capture noncommutativity. These bounds quantify the degree to which the deterministic matrices A i behave as though they are freely independent. This "intrinsic freeness" phenomenon provides a powerful tool for the study of various questions that are outside the reach of classical methods of random matrix theory. Our nonasymptotic bounds are easily applicable in concrete situations, and yield sharp results in examples where the noncommutative Khintchine inequality is suboptimal. When combined with a linearization argument, our bounds imply strong asymptotic freeness (in the sense of Haagerup Thorbj o rnsen) for a remarkably general class of Gaussian random matrix models, including matrices that may be very sparse and that lack any special symmetries. Beyond the Gaussian setting, we develop matrix concentration inequalities that capture noncommutativity for general sums of independent random matrices, which arise in many problems of pure and applied mathematics.


Automatic Seizure Detection Using the Pulse Transit Time. Documentation of epileptic seizures plays an essential role in planning medical therapy. Solutions for automated epileptic seizure detection can help improve the current problem of incomplete and erroneous manual documentation of epileptic seizures. In recent years, a number of wearable sensors have been tested for this purpose. However, detecting seizures with subtle symptoms remains difficult and current solutions tend to have a high false alarm rate. Seizures can also affect the patient's arterial blood pressure, which has not yet been studied for detection with sensors. The pulse transit time (PTT) provides a noninvasive estimate of arterial blood pressure. It can be obtained by using to two sensors, which are measuring the time differences between arrivals of the pulse waves. Due to separated time chips a clock drift emerges, which is strongly influencing the PTT. In this work, we present an algorithm which responds to alterations in the PTT, considering the clock drift and enabling the noninvasive monitoring of blood pressure alterations using separated sensors. Furthermore we investigated whether seizures can be detected using the PTT. Our results indicate that using the algorithm, it is possible to detect seizures with a Random Forest. Using the PTT along with other signals in a multimodal approach, the detection of seizures with subtle symptoms could thereby be improved.


Optimal communication and control strategies in a multi agent MDP problem. The problem of controlling multi agent systems under different models of information sharing among agents has received significant attention in the recent literature. In this paper, we consider a setup where rather than committing to a fixed information sharing protocol (e.g. periodic sharing or no sharing etc), agents can dynamically decide at each time step whether to share information with each other and incur the resulting communication cost. This setup requires a joint design of agents' communication and control strategies in order to optimize the trade off between communication costs and control objective. We first show that agents can ignore a big part of their private information without compromising the system performance. We then provide a common information approach based solution for the strategy optimization problem. This approach relies on constructing a fictitious POMDP whose solution (obtained via a dynamic program) characterizes the optimal strategies for the agents. We also show that our solution can be easily modified to incorporate constraints on when and how frequently agents can communicate.


A Reinforcement Learning Approach for Scheduling in mmWave Networks. We consider a source that wishes to communicate with a destination at a desired rate, over a mmWave network where links are subject to blockage and nodes to failure (e.g., in a hostile military environment). To achieve resilience to link and node failures, we here explore a state of the art Soft Actor Critic (SAC) deep reinforcement learning algorithm, that adapts the information flow through the network, without using knowledge of the link capacities or network topology. Numerical evaluations show that our algorithm can achieve the desired rate even in dynamic environments and it is robust against blockage.


Characterizing and comparing external measures for the assessment of cluster analysis and community detection. In the context of cluster analysis and graph partitioning, many external evaluation measures have been proposed in the literature to compare two partitions of the same set. This makes the task of selecting the most appropriate measure for a given situation a challenge for the end user. However, this issue is overlooked in the literature. Researchers tend to follow tradition and use the standard measures of their field, although they often became standard only because previous researchers started consistently using them. In this work, we propose a new empirical evaluation framework to solve this issue, and help the end user selecting an appropriate measure for their application. For a collection of candidate measures, it first consists in describing their behavior by computing them for a generated dataset of partitions, obtained by applying a set of predefined parametric partition transformations. Second, our framework performs a regression analysis to characterize the measures in terms of how they are affected by these parameters and transformations. This allows both describing and comparing the measures. Our approach is not tied to any specific measure or application, so it can be applied to any situation. We illustrate its relevance by applying it to a selection of standard measures, and show how it can be put in practice through two concrete use cases.


Armour Generalizable Compact Self Attention for Vision Transformers. Attention based transformer networks have demonstrated promising potential as their applications extend from natural language processing to vision. However, despite the recent improvements, such as sub quadratic attention approximation and various training enhancements, the compact vision transformers to date using the regular attention still fall short in comparison with its convnet counterparts, in terms of textit accuracy, textit model size , textit and textit throughput . This paper introduces a compact self attention mechanism that is fundamental and highly generalizable. The proposed method reduces redundancy and improves efficiency on top of the existing attention optimizations. We show its drop in applicability for both the regular attention mechanism and some most recent variants in vision transformers. As a result, we produced smaller and faster models with the same or better accuracies.


Hash Layers For Large Sparse Models. We investigate the training of sparse layers that use different parameters for different inputs based on hashing in large Transformer models. Specifically, we modify the feedforward layer to hash to different sets of weights depending on the current token, over all tokens in the sequence. We show that this procedure either outperforms or is competitive with learning to route mixture of expert methods such as Switch Transformers and BASE Layers, while requiring no routing parameters or extra terms in the objective function such as a load balancing loss, and no sophisticated assignment algorithm. We study the performance of different hashing techniques, hash sizes and input features, and show that balanced and random hashes focused on the most local features work best, compared to either learning clusters or using longer range context. We show our approach works well both on large language modeling and dialogue tasks, and on downstream fine tuning tasks.


GraphEBM Molecular Graph Generation with Energy Based Models. We note that most existing approaches for molecular graph generation fail to guarantee the intrinsic property of permutation invariance, resulting in unexpected bias in generative models. In this work, we propose GraphEBM to generate molecular graphs using energy based models. In particular, we parameterize the energy function in a permutation invariant manner, thus making GraphEBM permutation invariant. We apply Langevin dynamics to train the energy function by approximately maximizing likelihood and generate samples with low energies. Furthermore, to generate molecules with a desirable property, we propose a simple yet effective strategy, which pushes down energies with flexible degrees according to the properties of corresponding molecules. Finally, we explore the use of GraphEBM for generating molecules with multiple objectives in a compositional manner. Comprehensive experimental results on random, goal directed, and compositional generation tasks demonstrate the effectiveness of our proposed method.


The Deepfake Detection Dilemma A Multistakeholder Exploration of Adversarial Dynamics in Synthetic Media. Synthetic media detection technologies label media as either synthetic or non synthetic and are increasingly used by journalists, web platforms, and the general public to identify misinformation and other forms of problematic content. As both well resourced organizations and the non technical general public generate more sophisticated synthetic media, the capacity for purveyors of problematic content to adapt induces a newterm detection dilemma as detection practices become more accessible, they become more easily circumvented. This paper describes how a multistakeholder cohort from academia, technology platforms, media entities, and civil society organizations active in synthetic media detection and its socio technical implications evaluates the detection dilemma. Specifically, we offer an assessment of detection contexts and adversary capacities sourced from the broader, global AI and media integrity community concerned with mitigating the spread of harmful synthetic media. A collection of personas illustrates the intersection between unsophisticated and highly resourced sponsors of misinformation in the context of their technical capacities. This work concludes that there is no "best" approach to navigating the detector dilemma, but derives a set of implications from multistakeholder input to better inform detection process decisions and policies, in practice.


DRAN Detailed Region Adaptive Normalization for Conditional Image Synthesis. In recent years, conditional image synthesis has attracted growing attention due to its controllability in the image generation process. Although recent works have achieved realistic results, most of them fail to handle fine grained styles with subtle details. To address this problem, a novel normalization module, named DRAN, is proposed. It learns fine grained style representation, while maintaining the robustness to general styles. Specifically, we first introduce a multi level structure, Spatiality Aware Pyramid Pooling, to guide the model to learn coarse to fine features. Then, to adaptively fuse different levels of styles, we propose Dynamic Gating, making it possible to choose different styles according to different spatial regions. To evaluate the effectiveness and generalization ability of DRAN, we conduct a set of experiments on makeup transfer and semantic image synthesis. Quantitative and qualitative experiments show that equipped with DRAN, the baseline models are able to achieve significant improvement in complex style transfer and texture details reconstruction.


Siamese Labels Auxiliary Network(SiLaNet). Auxiliary information attracts more and more attention in the area of machine learning. Attempts so far to include such auxiliary information in state of the art learning process have often been based on simply appending these auxiliary features to the data level or feature level. In this paper, we intend to propose a novel training method with new options and architectures. Siamese labels, which were used in the training phase as auxiliary modules. While in the testing phase, the auxiliary module should be removed. Siamese label module makes it easier to train and improves the performance in testing process. In general, the main contributions can be summarized as, 1) Siamese Labels are firstly proposed as auxiliary information to improve the learning efficiency 2) We establish a new architecture, Siamese Labels Auxiliary Network (SilaNet), which is to assist the training of the model 3) Siamese Labels Auxiliary Network is applied to compress the model parameters by 50 and ensure the high accuracy at the same time. For the purpose of comparison, we tested the network on CIFAR 10 and CIFAR100 using some common models. The proposed SilaNet performs excellent efficiency both on the accuracy and robustness.


On the structure of 1 generator quasi polycyclic codes over finite chain rings. Quasi polycyclic (QP for short) codes over a finite chain ring R are a generalization of quasi cyclic codes, and these codes can be viewed as an R x submodule of mathcal R m ell , where mathcal R m R x langle f rangle , and f is a monic polynomial of degree m over R . If f factors uniquely into monic and coprime basic irreducibles, then their algebraic structure allow us to characterize the generator polynomials and the minimal generating sets of 1 generator QP codes as R modules. In addition, we also determine the parity check polynomials for these codes by using the strong Gr " o bner bases. In particular, via Magma system, some quaternary codes with new parameters are derived from these 1 generator QP codes.


Research on Fast Text Recognition Method for Financial Ticket Image. Currently, deep learning methods have been widely applied in and thus promoted the development of different fields. In the financial accounting field, the rapid increase in the number of financial tickets dramatically increases labor costs hence, using a deep learning method to relieve the pressure on accounting is necessary. At present, a few works have applied deep learning methods to financial ticket recognition. However, first, their approaches only cover a few types of tickets. In addition, the precision and speed of their recognition models cannot meet the requirements of practical financial accounting systems. Moreover, none of the methods provides a detailed analysis of both the types and content of tickets. Therefore, this paper first analyzes the different features of 482 kinds of financial tickets, divides all kinds of financial tickets into three categories and proposes different recognition patterns for each category. These recognition patterns can meet almost all types of financial ticket recognition needs. Second, regarding the fixed format types of financial tickets (accounting for 68.27 of the total types of tickets), we propose a simple yet efficient network named the Financial Ticket Faster Detection network (FTFDNet) based on a Faster RCNN. Furthermore, according to the characteristics of the financial ticket text, in order to obtain higher recognition accuracy, the loss function, Region Proposal Network (RPN), and Non Maximum Suppression (NMS) are improved to make FTFDNet focus more on text. Finally, we perform a comparison with the best ticket recognition model from the ICDAR2019 invoice competition. The experimental results illustrate that FTFDNet increases the processing speed by 50 while maintaining similar precision.


LenAtten An Effective Length Controlling Unit For Text Summarization. Fixed length summarization aims at generating summaries with a preset number of words or characters. Most recent researches incorporate length information with word embeddings as the input to the recurrent decoding unit, causing a compromise between length controllability and summary quality. In this work, we present an effective length controlling unit Length Attention (LenAtten) to break this trade off. Experimental results show that LenAtten not only brings improvements in length controllability and ROGUE scores but also has great generalization ability. In the task of generating a summary with the target length, our model is 732 times better than the best performing length controllable summarizer in length controllability on the CNN Daily Mail dataset.


Asymptotic preserving schemes for SDEs driven by fractional Brownian motion in the averaging regime. We design numerical schemes for a class of slow fast systems of stochastic differential equations, where the fast component is an Ornstein Uhlenbeck process and the slow component is driven by a fractional Brownian motion with Hurst index H 1 2 . We establish the asymptotic preserving property of the proposed scheme when the time scale parameter goes to 0 , a limiting scheme which is consistent with the averaged equation is obtained. With this numerical analysis point of view, we thus illustrate the recently proved averaging result for the considered SDE systems and the main differences with the standard Wiener case.


Estimating the Impact of BGP Prefix Hijacking. BGP prefix hijacking is a critical threat to the resilience and security of communications in the Internet. While several mechanisms have been proposed to prevent, detect or mitigate hijacking events, it has not been studied how to accurately quantify the impact of an ongoing hijack. When detecting a hijack, existing methods do not estimate how many networks in the Internet are affected (before and or after its mitigation). In this paper, we study fundamental and practical aspects of the problem of estimating the impact of an ongoing hijack through network measurements. We derive analytical results for the involved trade offs and limits, and investigate the performance of different measurement approaches (control data plane measurements) and use of public measurement infrastructure. Our findings provide useful insights for the design of accurate hijack impact estimation methodologies. Based on these insights, we design (i) a lightweight and practical estimation methodology that employs ping measurements, and (ii) an estimator that employs public infrastructure measurements and eliminates correlations between them to improve the accuracy. We validate the proposed methodologies and findings against results from hijacking experiments we conduct in the real Internet.


KIT Bus A Shuttle Model for CARLA Simulator. With the continuous development of science and technology, self driving vehicles will surely change the nature of transportation and realize the automotive industry's transformation in the future. Compared with self driving cars, self driving buses are more efficient in carrying passengers and more environmentally friendly in terms of energy consumption. Therefore, it is speculated that in the future, self driving buses will become more and more important. As a simulator for autonomous driving research, the CARLA simulator can help people accumulate experience in autonomous driving technology faster and safer. However, a shortcoming is that there is no modern bus model in the CARLA simulator. Consequently, people cannot simulate autonomous driving on buses or the scenarios interacting with buses. Therefore, we built a bus model in 3ds Max software and imported it into the CARLA to fill this gap. Our model, namely KIT bus, is proven to work in the CARLA by testing it with the autopilot simulation. The video demo is shown on our Youtube.


Wavelet Packets for Deepfake Image Analysis and Detection. As neural networks become able to generate realistic artificial images, they have the potential to improve movies, music, video games and make the internet an even more creative and inspiring place. Yet, the latest technology potentially enables new digital ways to lie. In response, the need for a diverse and reliable method toolbox arises to identify artificial images and other content. Previous work primarily relies on pixel space CNNs or the Fourier transform. To the best of our knowledge, synthesized fake image analysis and detection methods based on a multi scale wavelet representation, localized in both space and frequency, have been absent thus far. The wavelet transform conserves spatial information to a degree, which allows us to present a new analysis. Comparing the wavelet coefficients of real and fake images allows interpretation. Significant differences are identified. Additionally, this paper proposes to learn a model for the detection of synthetic images based on the wavelet packet representation of natural and GAN generated images. Our lightweight forensic classifiers exhibit competitive or improved performance at comparatively small network sizes, as we demonstrate on the FFHQ, CelebA and LSUN source identification problems. Furthermore, we study the binary FaceForensics fake detection problem.


NetFC enabling accurate floating point arithmetic on programmable switches. In network computation has been widely used to accelerate data intensive distributed applications. Some computational tasks, traditional performed on servers, are offloaded to the network (i.e. programmable switches). However, the computational capacity of programmable switches is limited to simple integer arithmetic operations while many of applications require on the fly floating point operations. To address this issue, prior approaches either adopt a float to integer method or directly offload computational tasks to the local CPUs of switches, incurring accuracy loss and delayed processing. To this end, we propose NetFC, a table lookup method to achieve on the fly in network floating point arithmetic operations nearly without accuracy loss. NetFC adopts a divide and conquer mechanism that converts the original huge table into several much small tables together with some integer operations. NetFC adopts a scaling factor mechanism for computational accuracy improvement, and a prefix based lossless table compression method to reduce the memory overhead. We use different types of datasets to evaluate NetFC. The experimental results show that the average accuracy of NetFC can be as high as up to 99.94 at worst with only 448KB memory consumption. Furthermore, we integrate NetFC into Sonata for detecting Slowloris attack, yielding significant decrease of detection delay.


Canonical forms for boundary conditions of self adjoint differential operators. Canonical forms of boundary conditions are important in the study of the eigenvalues of boundary conditions and their numerical computations. The known canonical forms for self adjoint differential operators, with eigenvalue parameter dependent boundary conditions, are limited to 4 th order differential operators. We derive canonical forms for self adjoint 2n th order differential operators with eigenvalue parameter dependent boundary conditions. We compare the 4 th order canonical forms to the canonical forms derived in this article.


Limits and colimits, generators and relations of partial groups. We analyse limits and colimits in the category Part of partial groups, algebraic structures introduced by A. Chermak, and apply the results in order to study generators and relations. We will prove that Part is both complete and cocomplete and, in addition, that the full subcategory of finite partial groups is both finitely complete and finitely cocomplete. A. Gonz ' a lez has proven that Part is equivalent to a full subcategory of the category sSet of simplicial sets. We will show that such subcategory is not closed under formation of colimits in sSet , so that a different construction must be taken into consideration. In addition, cocompleteness allows us to define quotients and free partial groups this provides the setting for studying generators and relations and for proving that all partial groups are a quotient of a free partial group.


New sequences of non free rational points. We exhibit some new infinite families of rational values of tau , some of them squares of rationals, for which the group or even the semigroup generated by the matrices left( begin smallmatrix 1 1 0 1 end smallmatrix right) and left( begin smallmatrix 1 0 tau 1 end smallmatrix right) is not free.


The Ordered Join of Impartial Games. Inspired by the theory of poset games, we introduce a new compound of impartial combinatorial games and provide a complete analysis in the spirit of the Sprague Grundy theory. Furthermore, we establish several substitution and reduction principles for this compound and consider its computational aspects.


Multi agent deep reinforcement learning (MADRL) meets multi user MIMO systems. A multi agent deep reinforcement learning (MADRL) is a promising approach to challenging problems in wireless environments involving multiple decision makers (or actors) with high dimensional continuous action space. In this paper, we present a MADRL based approach that can jointly optimize precoders to achieve the outer boundary, called pareto boundary, of the achievable rate region for a multiple input single output (MISO) interference channel (IFC). In order to address two main challenges, namely, multiple actors (or agents) with partial observability and multi dimensional continuous action space in MISO IFC setup, we adopt a multi agent deep deterministic policy gradient (MA DDPG) framework in which decentralized actors with partial observability can learn a multi dimensional continuous policy in a centralized manner with the aid of shared critic with global information. Meanwhile, we will also address a phase ambiguity issue with the conventional complex baseband representation of signals widely used in radio communications. In order to mitigate the impact of phase ambiguity on training performance, we propose a training method, called phase ambiguity elimination (PAE), that leads to faster learning and better performance of MA DDPG in wireless communication systems. The simulation results exhibit that MA DDPG is capable of learning a near optimal precoding strategy in a MISO IFC environment. To the best of our knowledge, this is the first work to demonstrate that the MA DDPG framework can jointly optimize precoders to achieve the pareto boundary of achievable rate region in a multi cell multi user multi antenna system.


Algorithms and Lower Bounds for Comparator Circuits from Shrinkage. Comparator circuits are a natural circuit model for studying bounded fan out computation whose power sits between nondeterministic branching programs and general circuits. Despite having been studied for nearly three decades, the first superlinear lower bound against comparator circuits was proved only recently by G 'al and Robere (ITCS 2020), who established a Omega((n log n) 1.5 ) lower bound on the size of comparator circuits computing an explicit function of n bits. In this paper, we initiate the study of average case complexity and circuit analysis algorithms for comparator circuits. Departing from previous approaches, we exploit the technique of shrinkage under random restrictions to obtain a variety of new results for this model. Among them, we show Average case Lower Bounds. For every k k(n) with k geq log n , there exists a polynomial time computable function f k on n bits such that, for every comparator circuit C with at most n 1.5 O(k cdot sqrt log n ) gates, we have text Pr x in left 0,1 right n left C(x) f k(x) right leq frac 1 2 frac 1 2 Omega(k) . This average case lower bound matches the worst case lower bound of G 'al and Robere by letting k O( log n) . SAT Algorithms. There is an algorithm that counts the number of satisfying assignments of a given comparator circuit with at most n 1.5 O ! left(k cdot sqrt log n right) gates, in time 2 n k cdot text poly (n) , for any k leq n 4 . The running time is non trivial when k omega( log n) . Pseudorandom Generators and MCSP Lower Bounds. There is a pseudorandom generator of seed length s 2 3 o(1) that fools comparator circuits with s gates. Also, using this PRG, we obtain an n 1.5 o(1) lower bound for MCSP against comparator circuits.


Multilevel Monte Carlo learning. In this work, we study the approximation of expected values of functional quantities on the solution of a stochastic differential equation (SDE), where we replace the Monte Carlo estimation with the evaluation of a deep neural network. Once the neural network training is done, the evaluation of the resulting approximating function is computationally highly efficient so that using deep neural networks to replace costly Monte Carlo integration is appealing, e.g., for near real time computations in quantitative finance. However, the drawback of these nowadays widespread ideas lies in the fact that training a suitable neural network is likely to be prohibitive in terms of computational cost. We address this drawback here by introducing a multilevel approach to the training of deep neural networks. More precisely, we combine the deep learning algorithm introduced by Beck et al. with the idea of multilevel Monte Carlo path simulation of Giles. The idea is to train several neural networks, each having a certain approximation quality and computational complexity, with training data computed from so called level estimators, introduced by Giles. We show that under certain assumptions, the variance in the training process can be reduced by shifting most of the computational workload to training neural nets at coarse levels where producing the training data sets is comparably cheap, whereas training the neural nets corresponding to the fine levels requires only a limited number of training data sets. We formulate a complexity theorem showing that the multilevel idea can indeed reduce computational complexity.


A Retrospective Analysis using Deep Learning Models for Prediction of Survival Outcome and Benefit of Adjuvant Chemotherapy in Stage II III Colorectal Cancer. Most early stage colorectal cancer (CRC) patients can be cured by surgery alone, and only certain high risk early stage CRC patients benefit from adjuvant chemotherapies. However, very few validated biomarkers are available to accurately predict survival benefit from postoperative chemotherapy. We developed a novel deep learning algorithm (CRCNet) using whole slide images from Molecular and Cellular Oncology (MCO) to predict survival benefit of adjuvant chemotherapy in stage II III CRC. We validated CRCNet both internally through cross validation and externally using an independent cohort from The Cancer Genome Atlas (TCGA). We showed that CRCNet can accurately predict not only survival prognosis but also the treatment effect of adjuvant chemotherapy. The CRCNet identified high risk subgroup benefits from adjuvant chemotherapy most and significant longer survival is observed among chemo treated patients. Conversely, minimal chemotherapy benefit is observed in the CRCNet low and medium risk subgroups. Therefore, CRCNet can potentially be of great use in guiding treatments for Stage II III CRC.


Convergence problem of the Kawahara equation on the real line. In this paper, we consider the convergence problem of the Kawahara equation begin eqnarray u t alpha partial x 5 u beta partial x 3 u partial x (u 2 ) 0 end eqnarray on the real line with rough data. Firstly, by using Strichartz estimates as well as high low frequency idea, we establish two crucial bilinear estimates, which are just Lemmas 3.1 3.2 in this paper we also present the proof of Lemma 3.3 which shows that s frac 1 2 is necessary for Lemma 3.2. Secondly, by using frequency truncated technique and high low frequency technique, we show the pointwise convergence of the Kawahara equation with rough data in H s ( R)(s geq frac 1 4 ) more precisely, we prove begin eqnarray lim limits t rightarrow0 u(x,t) u(x,0), qquad a.e. x in R, end eqnarray where u(x,t) is the solution to the Kawahara equation with initial data u(x,0). Lastly, we show begin eqnarray lim limits t rightarrow0 sup limits x in SR u(x,t) U(t)u 0 0 end eqnarray with rough data in H s ( R)(s frac 1 2 ) .


Shuffle Transformer Rethinking Spatial Shuffle for Vision Transformer. Very recently, Window based Transformers, which computed self attention within non overlapping local windows, demonstrated promising results on image classification, semantic segmentation, and object detection. However, less study has been devoted to the cross window connection which is the key element to improve the representation ability. In this work, we revisit the spatial shuffle as an efficient way to build connections among windows. As a result, we propose a new vision transformer, named Shuffle Transformer, which is highly efficient and easy to implement by modifying two lines of code. Furthermore, the depth wise convolution is introduced to complement the spatial shuffle for enhancing neighbor window connections. The proposed architectures achieve excellent performance on a wide range of visual tasks including image level classification, object detection, and semantic segmentation. Code will be released for reproduction.


Contact Tracing Information Improves the Performance of Group Testing Algorithms. Group testing can help maintain a widespread testing program using fewer resources amid a pandemic. In group testing, we are given n samples, one per individual. These samples are arranged into m n pooled samples, where each pool is obtained by mixing a subset of the n individual samples. Infected individuals are then identified using a group testing algorithm. In this paper, we use side information (SI) collected from contact tracing (CT) within nonadaptive single stage group testing algorithms. We generate CT SI data by incorporating characteristics of disease spread between individuals. These data are fed into two signal and measurement models for group testing, and numerical results show that our algorithms provide improved sensitivity and specificity. We also show how to incorporate CT SI into the design of the pooling matrix. That said, our numerical results suggest that the utilization of SI in the pooling matrix design based on the minimization of a weighted coherence measure does not yield significant performance gains beyond the incorporation of SI in the group testing algorithm.


Differential Privacy in Privacy Preserving Big Data and Learning Challenge and Opportunity. Differential privacy (DP) has become the de facto standard of privacy preservation due to its strong protection and sound mathematical foundation, which is widely adopted in different applications such as big data analysis, graph data process, machine learning, deep learning, and federated learning. Although DP has become an active and influential area, it is not the best remedy for all privacy problems in different scenarios. Moreover, there are also some misunderstanding, misuse, and great challenges of DP in specific applications. In this paper, we point out a series of limits and open challenges of corresponding research areas. Besides, we offer potentially new insights and avenues on combining differential privacy with other effective dimension reduction techniques and secure multiparty computing to clearly define various privacy models.


Characterization of canonical systems with six types of coins for the change making problem. This paper analyzes a necessary and sufficient condition for the change making problem to be solvable with a greedy algorithm. The change making problem is to minimize the number of coins used to pay a given value in a specified currency system. This problem is NP hard, and therefore the greedy algorithm does not always yield an optimal solution. Yet for almost all real currency systems, the greedy algorithm outputs an optimal solution. A currency system for which the greedy algorithm returns an optimal solution for any value of payment is called a canonical system. Canonical systems with at most five types of coins have been characterized in previous studies. In this paper, we give characterization of canonical systems with six types of coins, and we propose a partial generalization of characterization of canonical systems.


On the Purity of Resolutions of Stanley Reisner Rings Associated to Reed Muller Codes. Following Johnsen and Verdure (2013), we can associate to any linear code C an abstract simplicial complex and in turn, a Stanley Reisner ring R C . The ring R C is a standard graded algebra over a field and its projective dimension is precisely the dimension of C . Thus R C admits a graded minimal free resolution and the resulting graded Betti numbers are known to determine the generalized Hamming weights of C . The question of purity of the minimal free resolution of R C was considered by Ghorpade and Singh (2020) when C is the generalized Reed Muller code. They showed that the resolution is pure in some cases and it is not pure in many other cases. Here we give a complete characterization of the purity of graded minimal free resolutions of Stanley Reisner rings associated to generalized Reed Muller codes of an arbitrary order.


On the Expressiveness of Assignment Messages. In this note we prove that the class of valuation functions representable via integral assignment messages is a proper subset of strong substitutes valuations. Thus, there are strong substitutes valuations not expressible via assignment messages.


On the Distribution of "Simple Stupid Bugs" in Unit Test Files An Exploratory Study. A key aspect of ensuring the quality of a software system is the practice of unit testing. Through unit tests, developers verify the correctness of production source code, thereby verifying the system's intended behavior under test. However, unit test code is subject to issues, ranging from bugs in the code to poor test case design (i.e., test smells). In this study, we compare and contrast the occurrences of a type of single statement bug fix known as "simple stupid bugs" (SStuBs) in test and non test (i.e., production) files in popular open source Java Maven projects. Our results show that SStuBs occur more frequently in non test files than in test files, with most fix related code associated with assertion statements in test files. Further, most test files exhibiting SStuBs also exhibit test smells. We envision our findings enabling tool vendors to better support developers in improving the maintenance of test suites.


Non invasive Assessment of Hepatic Venous Pressure Gradient (HVPG) Based on MR Flow Imaging and Computational Fluid Dynamics. Clinically significant portal hypertension (CSPH) is a severe complication of chronic liver disease associated with cirrhosis, which is diagnosed by the measurement of hepatic venous pressure gradient (HVPG). However, HVPG measurement is invasive and therefore difficult to be widely applied in clinical routines. There is no currently available technique to measure HVPG noninvasively. Computational fluid dynamics (CFD) has been used for noninvasive measurement of vascular pressure gradient in the intracranial and coronary arteries. However, it has been scarcely employed in the hepatic vessel system due to the difficulties in reconstructing precise vascular anatomies and setting appropriate boundary conditions. Several computer tomography and ultrasound based studies have verified the effectiveness of virtual HVPG (vHVPG) by directly connecting the portal veins and hepatic veins before CFD simulations. We apply the latest techniques of phase contrast magnetic resonance imaging (PC MRI) and DIXON to obtain the velocity and vessel anatomies at the same time. Besides, we improve the CFD pipeline in regards to the construction of vessel connections and reduction of calculation time. The proposed method shows high accuracy in the CSPH diagnosis in a study containing ten healthy volunteers and five patients. The MRI based noninvasive HVPG measurement is promising in the clinical application of CSPH diagnosis.


Deep reinforcement learning on a multi asset environment for trading. Financial trading has been widely analyzed for decades with market participants and academics always looking for advanced methods to improve trading performance. Deep reinforcement learning (DRL), a recently reinvigorated method with significant success in multiple domains, still has to show its benefit in the financial markets. We use a deep Q network (DQN) to design long short trading strategies for futures contracts. The state space consists of volatility normalized daily returns, with buying or selling being the reinforcement learning action and the total reward defined as the cumulative profits from our actions. Our trading strategy is trained and tested both on real and simulated price series and we compare the results with an index benchmark. We analyze how training based on a combination of artificial data and actual price series can be successfully deployed in real markets. The trained reinforcement learning agent is applied to trading the E mini S P 500 continuous futures contract. Our results in this study are preliminary and need further improvement.


Learning Human like Hand Reaching for Human Robot Handshaking. One of the first and foremost non verbal interactions that humans perform is a handshake. It has an impact on first impressions as touch can convey complex emotions. This makes handshaking an important skill for the repertoire of a social robot. In this paper, we present a novel framework for learning reaching behaviours for human robot handshaking behaviours for humanoid robots solely using third person human human interaction data. This is especially useful for non backdrivable robots that cannot be taught by demonstrations via kinesthetic teaching. Our approach can be easily executed on different humanoid robots. This removes the need for re training, which is especially tedious when training with human interaction partners. We show this by applying the learnt behaviours on two different humanoid robots with similar degrees of freedom but different shapes and control limits.


Mediating between Contact Feasibility and Robustness of Trajectory Optimization through Chance Complementarity Constraints. As robots move from the laboratory into the real world, motion planning will need to account for model uncertainty and risk. For robot motions involving intermittent contact, planning for uncertainty in contact is especially important, as failure to successfully make and maintain contact can be catastrophic. Here, we model uncertainty in terrain geometry and friction characteristics, and combine a risk sensitive objective with chance constraints to provide a trade off between robustness to uncertainty and constraint satisfaction with an arbitrarily high feasibility guarantee. We evaluate our approach in two simple examples a push block system for benchmarking and a single legged hopper. We demonstrate that chance constraints alone produce trajectories similar to those produced using strict complementarity constraints however, when equipped with a robust objective, we show the chance constraints can mediate a trade off between robustness to uncertainty and strict constraint satisfaction. Thus, our study may represent an important step towards reasoning about contact uncertainty in motion planning.


TRADE TRusted Anonymous Data Exchange Threat Sharing Using Blockchain Technology. Cyber attacks are becoming more frequent and sophisticated, introducing significant challenges for organizations to protect their systems and data from threat actors. Today, threat actors are highly motivated, persistent, and well founded and operate in a coordinated manner to commit a diversity of attacks using various sophisticated tactics, techniques, and procedures. Given the risks these threats present, it has become clear that organizations need to collaborate and share cyber threat information (CTI) and use it to improve their security posture. In this paper, we present TRADE TRusted Anonymous Data Exchange a collaborative, distributed, trusted, and anonymized CTI sharing platform based on blockchain technology. TRADE uses a blockchain based access control framework designed to provide essential features and requirements to incentivize and encourage organizations to share threat intelligence information. In TRADE, organizations can fully control their data by defining sharing policies enforced by smart contracts used to control and manage CTI sharing in the network. TRADE allows organizations to preserve their anonymity while keeping organizations fully accountable for their action in the network. Finally, TRADE can be easily integrated within existing threat intelligence exchange protocols such as trusted automated exchange of intelligence information (TAXII) and OpenDXL, thereby allowing a fast and smooth technology adaptation.


Falconer type functions in three variables. Let f in mathbb R x, y, z be a quadratic polynomial that depends on each variable and that does not have the form g(h(x) k(y) l(z)) . Let A, B, C be compact sets in mathbb R . Suppose that dim H(A) dim H(B) dim H(C) 2 , then we prove that the image set f(A, B, C) is of positive Lebesgue measure. Our proof is based on a result due to Eswarathasan, Iosevich, and Taylor (Advances in Mathematics, 2011), and a combinatorial argument from the finite field model.


Quantization of Deep Neural Networks for Accurate Edge Computing. Deep neural networks (DNNs) have demonstrated their great potential in recent years, exceeding the per formance of human experts in a wide range of applications. Due to their large sizes, however, compressiontechniques such as weight quantization and pruning are usually applied before they can be accommodated onthe edge. It is generally believed that quantization leads to performance degradation, and plenty of existingworks have explored quantization strategies aiming at minimum accuracy loss. In this paper, we argue thatquantization, which essentially imposes regularization on weight representations, can sometimes help toimprove accuracy. We conduct comprehensive experiments on three widely used applications fully con nected network (FCN) for biomedical image segmentation, convolutional neural network (CNN) for imageclassification on ImageNet, and recurrent neural network (RNN) for automatic speech recognition, and experi mental results show that quantization can improve the accuracy by 1 , 1.95 , 4.23 on the three applicationsrespectively with 3.5x 6.4x memory reduction.


Rota's Basis Conjecture for Binary Matroids with Density Close to One. Rota's basis conjecture (RBC) states that given a collection B of n bases in a matroid M of rank n, one can always find n disjoint rainbow bases with respect to B. We show that if M is a binary matroid having n k elements, then one can construct n k 3 disjoint rainbow bases, where b is a constant depending only on k.


ALF A Fitness Based Artificial Life Form for Evolving Large Scale Neural Networks. Machine Learning (ML) is becoming increasingly important in daily life. In this context, Artificial Neural Networks (ANNs) are a popular approach within ML methods to realize an artificial intelligence. Usually, the topology of ANNs is predetermined. However, there are problems where it is difficult to find a suitable topology. Therefore, Topology and Weight Evolving Artificial Neural Network (TWEANN) algorithms have been developed that can find ANN topologies and weights using genetic algorithms. A well known downside for large scale problems is that TWEANN algorithms often evolve inefficient ANNs and require long runtimes. To address this issue, we propose a new TWEANN algorithm called Artificial Life Form (ALF) with the following technical advancements (1) speciation via structural and semantic similarity to form better candidate solutions, (2) dynamic adaptation of the observed candidate solutions for better convergence properties, and (3) integration of solution quality into genetic reproduction to increase the probability of optimization success. Experiments on large scale ML problems confirm that these approaches allow the fast solving of these problems and lead to efficient evolved ANNs.


On the equality problem of two variable Bajraktarevi 'c means under first order differentiability assumptions. The equality problem of the two variable Bajraktarevi 'c means can be expressed as the functional equation left( frac f g right) 1 bigg( frac f(x) f(y) g(x) g(y) bigg) left( frac h k right) 1 bigg( frac h(x) h(y) k(x) k(y) bigg) qquad(x,y in I), where I is a nonempty open real interval, f,g,h,k I to mathbb R are continuous functions, g , k are positive and f g , h k are strictly monotone. This functional equation, for the first time, was solved by Losonczi in 1999 under 6th order continuous differentiability assumptions. Additional and new characterizations of this equality problem have been found recently by Losonczi, P 'ales and Zakaria under the same regularity assumptions in 2021. In this paper it is shown that the same conclusion can be obtained under substantially weaker regularity conditions, namely, assuming only first order differentiability.


Detour Dual Optimal Inequalities for Column Generation with Application to Routing and Location. We consider the problem of accelerating column generation (CG) for logistics optimization problems using vehicle routing as an example. Without loss of generality, we focus on the Capacitated Vehicle Routing Problem (CVRP) via the addition of a new class of dual optimal inequalities (DOI) that incorporate information about detours from the vehicle routes. These inequalities extend the Smooth DOI recently introduced in the literature for the solution of certain classes of set covering problems by CG. The Detour DOI introduced in this article permit low cost swap operations between items on a given active route with items near to other items on that route to estimate (and bound) the values of the dual variables. Smooth DOI in contrast only permit low cost swap operations between nearby items. The use of Detour DOI permits a faster convergence of CG without weakening the linear programming relaxation. We then argue that these DOI can also be conveniently applied to single source capacitated facility location problems. These problems have been shown to be equivalent to a broad class of logistics optimization problems that include, for example telecommunication network design and production planning. The importance of developing vastly more efficient column generation solvers cannot be overstated. Detour DOI, which permit large numbers of columns to be expressed with a finite set of variables, contributes to this important endeavor.


A characterisation of the continuum Gaussian free field in d geq 2 dimensions. We prove that under certain mild moment and continuity assumptions, the d dimensional Gaussian free field is the only stochastic process in d geq 2 that is translation invariant, exhibits a certain scaling, and satisfies the usual domain Markov property. Our proof is based on a decomposition of the underlying functional space in terms of radial processes and spherical harmonics.


HCV Hierarchy Consistency Verification for Incremental Implicitly Refined Classification. Human beings learn and accumulate hierarchical knowledge over their lifetime. This knowledge is associated with previous concepts for consolidation and hierarchical construction. However, current incremental learning methods lack the ability to build a concept hierarchy by associating new concepts to old ones. A more realistic setting tackling this problem is referred to as Incremental Implicitly Refined Classification (IIRC), which simulates the recognition process from coarse grained categories to fine grained categories. To overcome forgetting in this benchmark, we propose Hierarchy Consistency Verification (HCV) as an enhancement to existing continual learning methods. Our method incrementally discovers the hierarchical relations between classes. We then show how this knowledge can be exploited during both training and inference. Experiments on three setups of varying difficulty demonstrate that our HCV module improves performance of existing continual learning methods under this IIRC setting by a large margin. Code is available in https github.com wangkai930418 HCV IIRC.


Modular approach to data preprocessing in ALOHA and application to a smart industry use case. Applications in the smart industry domain, such as interaction with collaborative robots using vocal commands or machine vision systems often requires the deployment of deep learning algorithms on heterogeneous low power computing platforms. The availability of software tools and frameworks to automatize different design steps can support the effective implementation of DL algorithms on embedded systems, reducing related effort and costs. One very important aspect for the acceptance of the framework, is its extensibility, i.e. the capability to accommodate different datasets and define customized preprocessing, without requiring advanced skills. The paper addresses a modular approach, integrated into the ALOHA tool flow, to support the data preprocessing and transformation pipeline. This is realized through customizable plugins and allows the easy extension of the tool flow to encompass new use cases. To demonstrate the effectiveness of the approach, we present some experimental results related to a keyword spotting use case and we outline possible extensions to different use cases.


A Case Study on Sampling Strategies for Evaluating Neural Sequential Item Recommendation Models. At the present time, sequential item recommendation models are compared by calculating metrics on a small item subset (target set) to speed up computation. The target set contains the relevant item and a set of negative items that are sampled from the full item set. Two well known strategies to sample negative items are uniform random sampling and sampling by popularity to better approximate the item frequency distribution in the dataset. Most recently published papers on sequential item recommendation rely on sampling by popularity to compare the evaluated models. However, recent work has already shown that an evaluation with uniform random sampling may not be consistent with the full ranking, that is, the model ranking obtained by evaluating a metric using the full item set as target set, which raises the question whether the ranking obtained by sampling by popularity is equal to the full ranking. In this work, we re evaluate current state of the art sequential recommender models from the point of view, whether these sampling strategies have an impact on the final ranking of the models. We therefore train four recently proposed sequential recommendation models on five widely known datasets. For each dataset and model, we employ three evaluation strategies. First, we compute the full model ranking. Then we evaluate all models on a target set sampled by the two different sampling strategies, uniform random sampling and sampling by popularity with the commonly used target set size of 100, compute the model ranking for each strategy and compare them with each other. Additionally, we vary the size of the sampled target set. Overall, we find that both sampling strategies can produce inconsistent rankings compared with the full ranking of the models. Furthermore, both sampling by popularity and uniform random sampling do not consistently produce the same ranking ...


On the minimum degree of minimal Ramsey graphs for cliques versus cycles. A graph G is said to be q Ramsey for a q tuple of graphs (H 1, ldots,H q) , denoted by G to q(H 1, ldots,H q) , if every q edge coloring of G contains a monochromatic copy of H i in color i, for some i in q . Let s q(H 1, ldots,H q) denote the smallest minimum degree of G over all graphs G that are minimal q Ramsey for (H 1, ldots,H q) (with respect to subgraph inclusion). The study of this parameter was initiated in 1976 by Burr, Erd H o s and Lov 'asz, who determined its value precisely for a pair of cliques. Over the past two decades the parameter s q has been studied by several groups of authors, the main focus being on the symmetric case, where H i cong H for all i in q . The asymmetric case, in contrast, has received much less attention. In this paper, we make progress in this direction, studying asymmetric tuples consisting of cliques, cycles and trees. We determine s 2(H 1,H 2) when (H 1,H 2) is a pair of one clique and one tree, a pair of one clique and one cycle, and when it is a pair of two different cycles. We also generalize our results to multiple colors and obtain bounds on s q(C ell, ldots,C ell,K t, ldots,K t) in terms of the size of the cliques t , the number of cycles, and the number of cliques. Our bounds are tight up to logarithmic factors when two of the three parameters are fixed.


A Right Invariant Extended Kalman Filter for Object based SLAM. With the recent advance of deep learning based object recognition and estimation, it is possible to consider object level SLAM where the pose of each object is estimated in the SLAM process. In this paper, based on a novel Lie group structure, a right invariant extended Kalman filter (RI EKF) for object based SLAM is proposed. The observability analysis shows that the proposed algorithm automatically maintains the correct unobservable subspace, while standard EKF (Std EKF) based SLAM algorithm does not. This results in a better consistency for the proposed algorithm comparing to Std EKF. Finally, simulations and real world experiments validate not only the consistency and accuracy of the proposed algorithm, but also the practicability of the proposed RI EKF for object based SLAM problem. The MATLAB code of the algorithm is made publicly available.


Generalizing the Lehmer's totient problem. An important unsolved question in number theory is the Lehmer's totient problem that asks whether there exists any composite number n such that varphi(n) mid n 1 , where varphi is the Euler's totient function. It is known that if any such n exists, it must be odd, square free, greater that 10 30 , and divisible by at least 15 distinct primes. Such a number must be also a Carmichael number. In this short note, we discuss a group theoretical analogous problem involving the function that counts the number of automorphisms of a finite group. Another way to generalize the Lehmer's totient problem is also proposed.


Common Information based Approximate State Representations in Multi Agent Reinforcement Learning. Due to information asymmetry, finding optimal policies for Decentralized Partially Observable Markov Decision Processes (Dec POMDPs) is hard with the complexity growing doubly exponentially in the horizon length. The challenge increases greatly in the multi agent reinforcement learning (MARL) setting where the transition probabilities, observation kernel, and reward function are unknown. Here, we develop a general compression framework with approximate common and private state representations, based on which decentralized policies can be constructed. We derive the optimality gap of executing dynamic programming (DP) with the approximate states in terms of the approximation error parameters and the remaining time steps. When the compression is exact (no error), the resulting DP is equivalent to the one in existing work. Our general framework generalizes a number of methods proposed in the literature. The results shed light on designing practically useful deep MARL network structures under the "centralized learning distributed execution" scheme.


Few Sample Named Entity Recognition for Security Vulnerability Reports by Fine Tuning Pre Trained Language Models. Public security vulnerability reports (e.g., CVE reports) play an important role in the maintenance of computer and network systems. Security companies and administrators rely on information from these reports to prioritize tasks on developing and deploying patches to their customers. Since these reports are unstructured texts, automatic information extraction (IE) can help scale up the processing by converting the unstructured reports to structured forms, e.g., software names and versions and vulnerability types. Existing works on automated IE for security vulnerability reports often rely on a large number of labeled training samples. However, creating massive labeled training set is both expensive and time consuming. In this work, for the first time, we propose to investigate this problem where only a small number of labeled training samples are available. In particular, we investigate the performance of fine tuning several state of the art pre trained language models on our small training dataset. The results show that with pre trained language models and carefully tuned hyperparameters, we have reached or slightly outperformed the state of the art system on this task. Consistent with previous two step process of first fine tuning on main category and then transfer learning to others as in 7 , if otherwise following our proposed approach, the number of required labeled samples substantially decrease in both stages 90 reduction in fine tuning from 5758 to 576,and 88.8 reduction in transfer learning with 64 labeled samples per category. Our experiments thus demonstrate the effectiveness of few sample learning on NER for security vulnerability report. This result opens up multiple research opportunities for few sample learning for security vulnerability reports, which is discussed in the paper. Code https github.com guanqun yang FewVulnerability.


A multi order smoothed particle hydrodynamics method for cardiac electromechanics with the Purkinje network. In previous work, Zhang et al. (2021) cite zhang2021integrative developed an integrated smoothed particle hydrodynamics (SPH) method to simulate the principle aspects of cardiac function, including electrophysiology, passive and active mechanical response of the myocardium. As the inclusion of the Purkinje network in electrocardiology is recognized as fundamental to accurately describing the electrical activation in the right and left ventricles, in this paper, we present a multi order SPH method to handle the electrical propagation through the Purkinje system and in the myocardium with monodomain monodomain coupling strategy. We first propose an efficient algorithm for network generation on arbitrarily complex surface by exploiting level set geometry representation and cell linked list neighbor search algorithm. Then, a reduced order SPH method is developed to solve the one dimensional monodomain equation to characterize the fast electrical activation through the Purkinje network. Finally, a multi order coupling paradigm is introduced to capture the coupled nature of potential propagation arising from the interaction between the network and the myocardium. A set of numerical examples are studied to assess the computational performance, accuracy and versatility of the proposed methods. In particular, numerical study performed in realistic left ventricle demonstrates that the present method features all the physiological issues that characterize a heartbeat simulation, including the initiation of the signal in the Purkinje network and the systolic and diastolic phases. As expected, the results underlie the importance of using physiologically realistic Purkinje network for modeling cardiac functions.


Equivariant cobordisms between freely periodic knots. We consider free symmetries on cobordisms between knots. We classify which freely periodic knots bound equivariant surfaces in the 4 ball in terms of corresponding homology classes in lens spaces. A key tool is the homology cobordism classification of lens spaces using d invariants. We give a numerical condition determining the free periods for which torus knots bound equivariant surfaces in the 4 ball.


Radio Resource and Beam Management in 5G mmWave Using Clustering and Deep Reinforcement Learning. To optimally cover users in millimeter Wave (mmWave) networks, clustering is needed to identify the number and direction of beams. The mobility of users motivates the need for an online clustering scheme to maintain up to date beams towards those clusters. Furthermore, mobility of users leads to varying patterns of clusters (i.e., users move from the coverage of one beam to another), causing dynamic traffic load per beam. As such, efficient radio resource allocation and beam management is needed to address the dynamicity that arises from mobility of users and their traffic. In this paper, we consider the coexistence of Ultra Reliable Low Latency Communication (URLLC) and enhanced Mobile BroadBand (eMBB) users in 5G mmWave networks and propose a Quality of Service (QoS) aware clustering and resource allocation scheme. Specifically, Density Based Spatial Clustering of Applications with Noise (DBSCAN) is used for online clustering of users and the selection of the number of beams. In addition, Long Short Term Memory (LSTM) based Deep Reinforcement Learning (DRL) scheme is used for resource block allocation. The performance of the proposed scheme is compared to a baseline that uses K means and priority based proportional fairness for clustering and resource allocation, respectively. Our simulation results show that the proposed scheme outperforms the baseline algorithm in terms of latency, reliability, and rate of URLLC users as well as rate of eMBB users.


MoSES 2PDF A GIS Compatible GPU accelerated High Performance Simulation Tool for Grain Fluid Shallow Flows. We introduce a GPU accelerated simulation tool, named Modeling on Shallow Flows with Efficient Simulation for Two Phase Debris Flows (MoSES 2PDF), of which the input and output data can be linked to the GIS system for engineering application. MoSES 2PDF is developed based on the CUDA structure so that it can well run with different NVIDIA GPU cards, once the CUDA vers. 9.2 (or higher) is installed. The performance of the MoSES 2PDF is evaluated, and it is found that the present GPU CUDA implementation can enhance efficiency by up to 230 folds, depending on the PC workstations, models of GPU card, and the mesh numbers in the computation domain. Two numerical examples are illustrated with two distinct initial inflow conditions, which are included in two modes of MoSES 2PDF, respectively. In the numerical example of a large scale event, the 2009 Hsiaolin event, the results computed by two distinct NVIDIA GPU cards (RTX 2080 Ti and Tesla V100) are found to be identical but only tiny deviation is figured out in comparison with the results computed by the conventional single core CPU code. It is speculated to be caused by the different structures in the source codes and some float double operations. In addition to the illustration in the GIS system, the computed results by MoSES 2PDF can also be shown with animated 3D graphics in the ANSI Platform, where the user can interact with 3D scenes. The feasibility, features, and facilities of MoSES 2PDF are demonstrated with respect to the two numerical examples concerning two real events.


A new upper bound for the Asymptotic Dimension of RACGs. Let W Gamma be the Right Angled Coxeter group with defining graph Gamma . We show that the asymptotic dimension of W Gamma is smaller than or equal to dim CC ( Gamma) , the clique connected dimension of the graph. As a corollary we show that W Gamma is virtually free if and only if dim CC ( Gamma) 1 .


An octagon containing the numerical range of a bounded linear operator. A polygon is derived that contains the numerical range of a bounded linear operator on a complex Hilbert space, using only norms. In its most general form, the polygon is an octagon, symmetric with respect to the origin, and tangent to the closure of the numerical range in at least four points when the spectral norm is used.


Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendation. Contrastive learning (CL) recently has spurred a fruitful line of research in the field of recommendation, since its ability to extract self supervised signals from the raw data is well aligned with recommender systems' needs for tackling the data sparsity issue. A typical pipeline of CL based recommendation models is first augmenting the user item bipartite graph with structure perturbations, and then maximizing the node representation consistency between different graph augmentations. Although this paradigm turns out to be effective, what underlies the performance gains is still a mystery. In this paper, we first experimentally disclose that, in CL based recommendation models, CL operates by learning more uniform user item representations that can implicitly mitigate the popularity bias. Meanwhile, we reveal that the graph augmentations, which used to be considered necessary, just play a trivial role. Based on this finding, we propose a simple CL method which discards the graph augmentations and instead adds uniform noises to the embedding space for creating contrastive views. A comprehensive experimental study on three benchmark datasets demonstrates that, though it appears strikingly simple, the proposed method can smoothly adjust the uniformity of learned representations and has distinct advantages over its graph augmentation based counterparts in terms of recommendation accuracy and training efficiency. The code is released at https github.com Coder Yu QRec.


Limiting Eigenvalue Behavior of a Class of Large Dimensional Random Matrices Formed From a Hadamard Product. This paper investigates the strong limiting behavior of the eigenvalues of the class of matrices frac1N(D n circ X n)(D n circ X n) , studied in Girko 2001. Here, X n (x ij ) is an n times N random matrix consisting of independent complex standardized random variables, D n (d ij ) , n times N , has nonnegative entries, and circ denotes Hadamard (componentwise) product. Results are obtained under assumptions on the entries of X n and D n which are different from those in Girko (2001), which include a Lindeberg condition on the entries of D n circ X n , as well as a bound on the average of the rows and columns of D n circ D n . The present paper separates the assumptions needed on X n and D n . It assumes a Lindeberg condition on the entries of X n , along with a tigntness like condition on the entries of D n ,